Swap Awareness API

This KEP proposes a new API to give users control over how much swap a container or pod can use. The current swap behavior in Kubernetes is implicit, which can lead to under-utilization of swap provisioned on a node. Explicit API control for swap enables Kubernetes users to directly manage swap for their workloads, eliminating assumptions about their requirements. This proposal also removes existing swap restrictions for features like In-Place Pod Resize and for Guaranteed pods (e.g. those with CPU pinning), allowing these workloads to benefit from swap. This KEP introduces a "WorkloadControlledSwap" mode where swap usage is explicitly defined by the user for each container or pod, defaulting to no swap if unspecified. This allows for better resource management and safer overcommitment of swap resources on a node.