Feature Gates
This page contains an overview of the various feature gates an administrator can specify on different Kubernetes components.
See feature stages for an explanation of the stages for a feature.
Overview
Feature gates are a set of key=value pairs that describe Kubernetes features.
You can turn these features on or off using the --feature-gates command line flag
on each Kubernetes component.
Each Kubernetes component lets you enable or disable a set of feature gates that
are relevant to that component.
Use -h flag to see a full set of feature gates for all components.
To set feature gates for a component, such as kubelet, use the --feature-gates
flag assigned to a list of feature pairs:
--feature-gates=...,GracefulNodeShutdown=true
The following tables are a summary of the feature gates that you can set on different Kubernetes components.
- The "Since" column contains the Kubernetes release when a feature is introduced or its release stage is changed.
- The "Until" column, if not empty, contains the last Kubernetes release in which you can still use a feature gate.
- If a feature is in the Alpha or Beta state, you can find the feature listed in the Alpha/Beta feature gate table.
- If a feature is stable you can find all stages for that feature listed in the Graduated/Deprecated feature gate table.
- The Graduated/Deprecated feature gate table also lists deprecated and withdrawn features.
Note:
For a reference to old feature gates that are removed, please refer to feature gates removed.Feature gates for Alpha or Beta features
| Feature | Default | Stage | Since | Until |
|---|---|---|---|---|
AllowParsingUserUIDFromCertAuth |
false |
Alpha | 1.33 | 1.33 |
AllowParsingUserUIDFromCertAuth |
true |
Beta | 1.34 | – |
AllowUnsafeMalformedObjectDeletion |
false |
Alpha | 1.32 | – |
APIResponseCompression |
false |
Alpha | 1.7 | 1.15 |
APIResponseCompression |
true |
Beta | 1.16 | – |
APIServerIdentity |
false |
Alpha | 1.20 | 1.25 |
APIServerIdentity |
true |
Beta | 1.26 | – |
APIServingWithRoutine |
false |
Alpha | 1.30 | – |
CBORServingAndStorage |
false |
Alpha | 1.32 | – |
ClearingNominatedNodeNameAfterBinding |
false |
Alpha | 1.34 | 1.34 |
CloudControllerManagerWebhook |
false |
Alpha | 1.27 | – |
ClusterTrustBundle |
false |
Alpha | 1.27 | 1.32 |
ClusterTrustBundle |
false |
Beta | 1.33 | – |
ClusterTrustBundleProjection |
false |
Alpha | 1.29 | 1.32 |
ClusterTrustBundleProjection |
false |
Beta | 1.33 | – |
ComponentFlagz |
false |
Alpha | 1.32 | – |
ComponentStatusz |
false |
Alpha | 1.32 | – |
ConcurrentWatchObjectDecode |
false |
Beta | 1.31 | – |
ContainerCheckpoint |
false |
Alpha | 1.25 | 1.29 |
ContainerCheckpoint |
true |
Beta | 1.30 | – |
ContainerRestartRules |
false |
Alpha | 1.34 | – |
ContainerStopSignals |
false |
Alpha | 1.33 | – |
ContextualLogging |
false |
Alpha | 1.24 | – |
ContextualLogging |
true |
Beta | 1.30 | – |
CoordinatedLeaderElection |
false |
Alpha | 1.31 | 1.32 |
CoordinatedLeaderElection |
false |
Beta | 1.33 | – |
CPUManagerPolicyAlphaOptions |
false |
Alpha | 1.23 | – |
CPUManagerPolicyBetaOptions |
true |
Beta | 1.23 | – |
CrossNamespaceVolumeDataSource |
false |
Alpha | 1.26 | – |
CSIVolumeHealth |
false |
Alpha | 1.21 | – |
CustomCPUCFSQuotaPeriod |
false |
Alpha | 1.12 | – |
DeclarativeValidation |
true |
Beta | 1.33 | – |
DeclarativeValidationTakeover |
false |
Beta | 1.33 | – |
DeploymentReplicaSetTerminatingReplicas |
false |
Alpha | 1.33 | – |
DetectCacheInconsistency |
true |
Beta | 1.34 | – |
DRAAdminAccess |
false |
Alpha | 1.32 | 1.33 |
DRAAdminAccess |
true |
Beta | 1.34 | – |
DRAConsumableCapacity |
false |
Alpha | 1.34 | – |
DRADeviceBindingConditions |
false |
Alpha | 1.34 | – |
DRADeviceTaints |
false |
Alpha | 1.33 | – |
DRAExtendedResource |
false |
Alpha | 1.34 | – |
DRAPartitionableDevices |
false |
Alpha | 1.33 | – |
DRAPrioritizedList |
false |
Alpha | 1.33 | 1.33 |
DRAPrioritizedList |
true |
Beta | 1.34 | – |
DRAResourceClaimDeviceStatus |
false |
Alpha | 1.32 | 1.32 |
DRAResourceClaimDeviceStatus |
true |
Beta | 1.33 | – |
DRASchedulerFilterTimeout |
false |
Alpha | 1.34 | – |
EnvFiles |
false |
Alpha | 1.34 | – |
EventedPLEG |
false |
Alpha | 1.26 | – |
ExternalServiceAccountTokenSigner |
false |
Alpha | 1.32 | 1.33 |
ExternalServiceAccountTokenSigner |
true |
Beta | 1.34 | – |
GracefulNodeShutdown |
false |
Alpha | 1.20 | 1.20 |
GracefulNodeShutdown |
true |
Beta | 1.21 | – |
GracefulNodeShutdownBasedOnPodPriority |
false |
Alpha | 1.23 | 1.23 |
GracefulNodeShutdownBasedOnPodPriority |
true |
Beta | 1.24 | – |
HostnameOverride |
false |
Alpha | 1.34 | – |
HPAConfigurableTolerance |
false |
Alpha | 1.33 | – |
HPAScaleToZero |
false |
Alpha | 1.16 | – |
ImageMaximumGCAge |
false |
Alpha | 1.29 | 1.29 |
ImageMaximumGCAge |
true |
Beta | 1.30 | – |
ImageVolume |
false |
Alpha | 1.31 | 1.32 |
ImageVolume |
false |
Beta | 1.33 | – |
InformerResourceVersion |
false |
Alpha | 1.30 | – |
InOrderInformers |
true |
Alpha | 1.33 | 1.33 |
InOrderInformers |
true |
Beta | 1.34 | – |
InPlacePodVerticalScaling |
false |
Alpha | 1.27 | 1.32 |
InPlacePodVerticalScaling |
true |
Beta | 1.33 | – |
InPlacePodVerticalScalingExclusiveCPUs |
false |
Alpha | 1.32 | – |
InPlacePodVerticalScalingExclusiveMemory |
false |
Alpha | 1.34 | – |
InTreePluginPortworxUnregister |
false |
Alpha | 1.23 | – |
JobManagedBy |
false |
Alpha | 1.30 | 1.31 |
JobManagedBy |
true |
Beta | 1.32 | – |
KubeletCrashLoopBackOffMax |
false |
Alpha | 1.32 | – |
KubeletEnsureSecretPulledImages |
false |
Alpha | 1.33 | – |
KubeletFineGrainedAuthz |
false |
Alpha | 1.32 | 1.32 |
KubeletFineGrainedAuthz |
true |
Beta | 1.33 | – |
KubeletInUserNamespace |
false |
Alpha | 1.22 | – |
KubeletPodResourcesDynamicResources |
false |
Alpha | 1.27 | 1.33 |
KubeletPodResourcesDynamicResources |
true |
Beta | 1.34 | – |
KubeletPodResourcesGet |
false |
Alpha | 1.27 | 1.33 |
KubeletPodResourcesGet |
true |
Beta | 1.34 | – |
KubeletPSI |
false |
Alpha | 1.33 | 1.33 |
KubeletPSI |
true |
Beta | 1.34 | – |
KubeletSeparateDiskGC |
false |
Alpha | 1.29 | 1.30 |
KubeletSeparateDiskGC |
true |
Beta | 1.31 | – |
KubeletServiceAccountTokenForCredentialProviders |
false |
Alpha | 1.33 | 1.33 |
KubeletServiceAccountTokenForCredentialProviders |
true |
Beta | 1.34 | – |
ListFromCacheSnapshot |
false |
Alpha | 1.33 | 1.33 |
ListFromCacheSnapshot |
true |
Beta | 1.34 | – |
LocalStorageCapacityIsolationFSQuotaMonitoring |
false |
Alpha | 1.15 | 1.30 |
LocalStorageCapacityIsolationFSQuotaMonitoring |
false |
Beta | 1.31 | – |
LoggingAlphaOptions |
false |
Alpha | 1.24 | – |
LoggingBetaOptions |
true |
Beta | 1.24 | – |
MatchLabelKeysInPodTopologySpread |
false |
Alpha | 1.25 | 1.26 |
MatchLabelKeysInPodTopologySpread |
true |
Beta | 1.27 | – |
MatchLabelKeysInPodTopologySpreadSelectorMerge |
true |
Beta | 1.34 | – |
MaxUnavailableStatefulSet |
false |
Alpha | 1.24 | – |
MemoryQoS |
false |
Alpha | 1.22 | – |
MutableCSINodeAllocatableCount |
false |
Alpha | 1.33 | 1.33 |
MutableCSINodeAllocatableCount |
false |
Beta | 1.34 | – |
MutatingAdmissionPolicy |
false |
Alpha | 1.30 | 1.33 |
MutatingAdmissionPolicy |
false |
Beta | 1.34 | – |
NodeLogQuery |
false |
Alpha | 1.27 | 1.29 |
NodeLogQuery |
false |
Beta | 1.30 | – |
NominatedNodeNameForExpectation |
false |
Alpha | 1.34 | – |
OpenAPIEnums |
false |
Alpha | 1.23 | 1.23 |
OpenAPIEnums |
true |
Beta | 1.24 | – |
PodAndContainerStatsFromCRI |
false |
Alpha | 1.23 | – |
PodCertificateRequest |
false |
Alpha | 1.34 | – |
PodDeletionCost |
false |
Alpha | 1.21 | 1.21 |
PodDeletionCost |
true |
Beta | 1.22 | – |
PodLevelResources |
false |
Alpha | 1.32 | 1.33 |
PodLevelResources |
true |
Beta | 1.34 | – |
PodLogsQuerySplitStreams |
false |
Alpha | 1.32 | – |
PodObservedGenerationTracking |
false |
Alpha | 1.33 | 1.33 |
PodObservedGenerationTracking |
true |
Beta | 1.34 | – |
PodReadyToStartContainersCondition |
false |
Alpha | 1.28 | 1.28 |
PodReadyToStartContainersCondition |
true |
Beta | 1.29 | – |
PodTopologyLabelsAdmission |
false |
Alpha | 1.33 | – |
PortForwardWebsockets |
false |
Alpha | 1.30 | 1.30 |
PortForwardWebsockets |
true |
Beta | 1.31 | – |
PreferSameTrafficDistribution |
false |
Alpha | 1.33 | 1.33 |
PreferSameTrafficDistribution |
true |
Beta | 1.34 | – |
PreventStaticPodAPIReferences |
true |
Beta | 1.34 | – |
ProcMountType |
false |
Alpha | 1.12 | 1.30 |
ProcMountType |
false |
Beta | 1.31 | 1.32 |
ProcMountType |
true |
Beta | 1.33 | – |
QOSReserved |
false |
Alpha | 1.11 | – |
ReduceDefaultCrashLoopBackOffDecay |
false |
Alpha | 1.33 | – |
RelaxedServiceNameValidation |
false |
Alpha | 1.34 | – |
ReloadKubeletServerCertificateFile |
true |
Beta | 1.31 | – |
RemoteRequestHeaderUID |
false |
Alpha | 1.32 | – |
ResourceHealthStatus |
false |
Alpha | 1.31 | – |
RotateKubeletServerCertificate |
false |
Alpha | 1.7 | 1.11 |
RotateKubeletServerCertificate |
true |
Beta | 1.12 | – |
RuntimeClassInImageCriApi |
false |
Alpha | 1.29 | – |
SchedulerAsyncAPICalls |
true |
Beta | 1.34 | – |
SchedulerAsyncPreemption |
false |
Alpha | 1.32 | 1.32 |
SchedulerAsyncPreemption |
true |
Beta | 1.33 | – |
SchedulerPopFromBackoffQ |
true |
Beta | 1.33 | – |
SELinuxChangePolicy |
false |
Alpha | 1.32 | 1.32 |
SELinuxChangePolicy |
true |
Beta | 1.33 | – |
SELinuxMount |
false |
Alpha | 1.30 | 1.32 |
SELinuxMount |
false |
Beta | 1.33 | – |
SELinuxMountReadWriteOncePod |
false |
Alpha | 1.25 | 1.26 |
SELinuxMountReadWriteOncePod |
false |
Beta | 1.27 | 1.27 |
SELinuxMountReadWriteOncePod |
true |
Beta | 1.28 | – |
ServiceAcccountNodeAudienceRestriction |
false |
Beta | 1.32 | 1.32 |
ServiceAcccountNodeAudienceRestriction |
true |
Beta | 1.33 | – |
SizeBasedListCostEstimate |
true |
Beta | 1.24 | – |
StorageCapacityScoring |
false |
Alpha | 1.33 | – |
StorageVersionAPI |
false |
Alpha | 1.20 | – |
StorageVersionHash |
false |
Alpha | 1.14 | 1.14 |
StorageVersionHash |
true |
Beta | 1.15 | – |
StorageVersionMigrator |
false |
Alpha | 1.30 | – |
StrictIPCIDRValidation |
false |
Alpha | 1.33 | – |
StructuredAuthenticationConfigurationEgressSelector |
true |
Beta | 1.34 | – |
SupplementalGroupsPolicy |
false |
Alpha | 1.31 | 1.32 |
SupplementalGroupsPolicy |
true |
Beta | 1.33 | – |
SystemdWatchdog |
true |
Beta | 1.32 | – |
TokenRequestServiceAccountUIDValidation |
true |
Beta | 1.34 | – |
TopologyManagerPolicyAlphaOptions |
false |
Alpha | 1.26 | – |
TopologyManagerPolicyBetaOptions |
false |
Beta | 1.26 | 1.27 |
TopologyManagerPolicyBetaOptions |
true |
Beta | 1.28 | – |
TranslateStreamCloseWebsocketRequests |
false |
Alpha | 1.29 | 1.29 |
TranslateStreamCloseWebsocketRequests |
true |
Beta | 1.30 | – |
UnauthenticatedHTTP2DOSMitigation |
false |
Beta | 1.28 | 1.28 |
UnauthenticatedHTTP2DOSMitigation |
true |
Beta | 1.29 | – |
UnknownVersionInteroperabilityProxy |
false |
Alpha | 1.28 | – |
UserNamespacesPodSecurityStandards |
false |
Alpha | 1.29 | – |
UserNamespacesSupport |
false |
Alpha | 1.28 | 1.29 |
UserNamespacesSupport |
false |
Beta | 1.30 | 1.32 |
UserNamespacesSupport |
true |
Beta | 1.33 | – |
WatchCacheInitializationPostStartHook |
false |
Beta | 1.31 | – |
WatchList |
false |
Alpha | 1.27 | 1.31 |
WatchList |
true |
Beta | 1.32 | 1.32 |
WatchList |
false |
Beta | 1.33 | 1.33 |
WatchList |
true |
Beta | 1.34 | – |
WatchListClient |
false |
Beta | 1.30 | – |
WindowsCPUAndMemoryAffinity |
false |
Alpha | 1.32 | – |
WindowsGracefulNodeShutdown |
false |
Alpha | 1.32 | 1.33 |
WindowsGracefulNodeShutdown |
true |
Beta | 1.34 | – |
Feature gates for graduated or deprecated features
| Feature | Default | Stage | Since | Until |
|---|---|---|---|---|
AllowDNSOnlyNodeCSR |
false |
Deprecated | 1.31 | – |
AllowInsecureKubeletCertificateSigningRequests |
false |
Deprecated | 1.31 | – |
AllowServiceLBStatusOnNonLB |
false |
Deprecated | 1.29 | – |
AnonymousAuthConfigurableEndpoints |
false |
Alpha | 1.31 | 1.31 |
AnonymousAuthConfigurableEndpoints |
true |
Beta | 1.32 | 1.33 |
AnonymousAuthConfigurableEndpoints |
true |
GA | 1.34 | – |
AnyVolumeDataSource |
false |
Alpha | 1.18 | 1.23 |
AnyVolumeDataSource |
true |
Beta | 1.24 | 1.32 |
AnyVolumeDataSource |
true |
GA | 1.33 | – |
APIServerTracing |
false |
Alpha | 1.22 | 1.26 |
APIServerTracing |
true |
Beta | 1.27 | 1.33 |
APIServerTracing |
true |
GA | 1.34 | – |
AuthorizeNodeWithSelectors |
false |
Alpha | 1.31 | 1.31 |
AuthorizeNodeWithSelectors |
true |
Beta | 1.32 | 1.33 |
AuthorizeNodeWithSelectors |
true |
GA | 1.34 | – |
AuthorizeWithSelectors |
false |
Alpha | 1.31 | 1.31 |
AuthorizeWithSelectors |
true |
Beta | 1.32 | 1.33 |
AuthorizeWithSelectors |
true |
GA | 1.34 | – |
BtreeWatchCache |
true |
Beta | 1.32 | 1.32 |
BtreeWatchCache |
true |
GA | 1.33 | – |
ComponentSLIs |
false |
Alpha | 1.26 | 1.26 |
ComponentSLIs |
true |
Beta | 1.27 | 1.31 |
ComponentSLIs |
true |
GA | 1.32 | – |
ConsistentListFromCache |
false |
Alpha | 1.28 | 1.30 |
ConsistentListFromCache |
true |
Beta | 1.31 | 1.33 |
ConsistentListFromCache |
true |
GA | 1.34 | – |
CPUManagerPolicyOptions |
false |
Alpha | 1.22 | 1.22 |
CPUManagerPolicyOptions |
true |
Beta | 1.23 | 1.32 |
CPUManagerPolicyOptions |
true |
GA | 1.33 | – |
CRDValidationRatcheting |
false |
Alpha | 1.28 | 1.29 |
CRDValidationRatcheting |
true |
Beta | 1.30 | 1.32 |
CRDValidationRatcheting |
true |
GA | 1.33 | – |
CronJobsScheduledAnnotation |
true |
Beta | 1.28 | 1.31 |
CronJobsScheduledAnnotation |
true |
GA | 1.32 | – |
CSIMigrationPortworx |
false |
Alpha | 1.23 | 1.24 |
CSIMigrationPortworx |
false |
Beta | 1.25 | 1.30 |
CSIMigrationPortworx |
true |
Beta | 1.31 | 1.32 |
CSIMigrationPortworx |
true |
GA | 1.33 | – |
CustomResourceFieldSelectors |
false |
Alpha | 1.30 | 1.30 |
CustomResourceFieldSelectors |
true |
Beta | 1.31 | 1.31 |
CustomResourceFieldSelectors |
true |
GA | 1.32 | – |
DisableAllocatorDualWrite |
false |
Alpha | 1.31 | 1.32 |
DisableAllocatorDualWrite |
false |
Beta | 1.33 | 1.33 |
DisableAllocatorDualWrite |
true |
GA | 1.34 | – |
DisableNodeKubeProxyVersion |
false |
Alpha | 1.29 | 1.30 |
DisableNodeKubeProxyVersion |
true |
Beta | 1.31.0 | 1.31.0 |
DisableNodeKubeProxyVersion |
false |
Deprecated | 1.31.1 | – |
DisableNodeKubeProxyVersion |
false |
Deprecated | 1.32 | 1.32 |
DisableNodeKubeProxyVersion |
true |
Deprecated | 1.33 | – |
DynamicResourceAllocation |
false |
Alpha | 1.30 | 1.31 |
DynamicResourceAllocation |
false |
Beta | 1.32 | 1.33 |
DynamicResourceAllocation |
true |
GA | 1.34 | – |
ElasticIndexedJob |
true |
Beta | 1.27 | 1.30 |
ElasticIndexedJob |
true |
GA | 1.31 | – |
ExecProbeTimeout |
true |
GA | 1.20 | – |
GitRepoVolumeDriver |
false |
Deprecated | 1.33 | – |
HonorPVReclaimPolicy |
false |
Alpha | 1.23 | 1.30 |
HonorPVReclaimPolicy |
true |
Beta | 1.31 | 1.32 |
HonorPVReclaimPolicy |
true |
GA | 1.33 | – |
InPlacePodVerticalScalingAllocatedStatus |
false |
Alpha | 1.32 | 1.32 |
InPlacePodVerticalScalingAllocatedStatus |
false |
Deprecated | 1.33 | – |
JobBackoffLimitPerIndex |
false |
Alpha | 1.28 | 1.28 |
JobBackoffLimitPerIndex |
true |
Beta | 1.29 | 1.32 |
JobBackoffLimitPerIndex |
true |
GA | 1.33 | – |
JobPodReplacementPolicy |
false |
Alpha | 1.28 | 1.28 |
JobPodReplacementPolicy |
true |
Beta | 1.29 | 1.33 |
JobPodReplacementPolicy |
true |
GA | 1.34 | – |
JobSuccessPolicy |
false |
Alpha | 1.30 | 1.30 |
JobSuccessPolicy |
true |
Beta | 1.31 | 1.32 |
JobSuccessPolicy |
true |
GA | 1.33 | – |
KMSv1 |
true |
Deprecated | 1.28 | 1.28 |
KMSv1 |
false |
Deprecated | 1.29 | – |
KubeletCgroupDriverFromCRI |
false |
Alpha | 1.28 | 1.30 |
KubeletCgroupDriverFromCRI |
true |
Beta | 1.31 | – |
KubeletCgroupDriverFromCRI |
true |
GA | 1.34 | – |
KubeletTracing |
false |
Alpha | 1.25 | 1.26 |
KubeletTracing |
true |
Beta | 1.27 | 1.33 |
KubeletTracing |
true |
GA | 1.34 | – |
LoadBalancerIPMode |
false |
Alpha | 1.29 | 1.30 |
LoadBalancerIPMode |
true |
Beta | 1.30 | 1.31 |
LoadBalancerIPMode |
true |
GA | 1.32 | – |
LogarithmicScaleDown |
false |
Alpha | 1.21 | 1.21 |
LogarithmicScaleDown |
true |
Beta | 1.22 | 1.30 |
LogarithmicScaleDown |
true |
GA | 1.31 | – |
MatchLabelKeysInPodAffinity |
false |
Alpha | 1.29 | 1.30 |
MatchLabelKeysInPodAffinity |
true |
Beta | 1.31 | 1.32 |
MatchLabelKeysInPodAffinity |
true |
GA | 1.33 | – |
MemoryManager |
false |
Alpha | 1.21 | 1.21 |
MemoryManager |
true |
Beta | 1.22 | 1.31 |
MemoryManager |
true |
GA | 1.32 | – |
MultiCIDRServiceAllocator |
false |
Alpha | 1.27 | 1.30 |
MultiCIDRServiceAllocator |
false |
Beta | 1.31 | 1.32 |
MultiCIDRServiceAllocator |
true |
GA | 1.33 | – |
NFTablesProxyMode |
false |
Alpha | 1.29 | 1.30 |
NFTablesProxyMode |
true |
Beta | 1.31 | 1.32 |
NFTablesProxyMode |
true |
GA | 1.33 | – |
NodeInclusionPolicyInPodTopologySpread |
false |
Alpha | 1.25 | 1.25 |
NodeInclusionPolicyInPodTopologySpread |
true |
Beta | 1.26 | 1.32 |
NodeInclusionPolicyInPodTopologySpread |
true |
GA | 1.33 | – |
NodeSwap |
false |
Alpha | 1.22 | 1.27 |
NodeSwap |
false |
Beta | 1.28 | 1.29 |
NodeSwap |
true |
Beta | 1.30 | 1.33 |
NodeSwap |
true |
GA | 1.34 | – |
OrderedNamespaceDeletion |
false |
Beta | 1.30 | 1.32 |
OrderedNamespaceDeletion |
true |
Beta | 1.33 | 1.33 |
OrderedNamespaceDeletion |
true |
GA | 1.34 | – |
PodIndexLabel |
true |
Beta | 1.28 | 1.31 |
PodIndexLabel |
true |
GA | 1.32 | – |
PodLifecycleSleepAction |
false |
Alpha | 1.29 | 1.29 |
PodLifecycleSleepAction |
true |
Beta | 1.30 | 1.33 |
PodLifecycleSleepAction |
true |
GA | 1.34 | – |
PodLifecycleSleepActionAllowZero |
false |
Alpha | 1.32 | 1.32 |
PodLifecycleSleepActionAllowZero |
true |
Beta | 1.33 | 1.33 |
PodLifecycleSleepActionAllowZero |
true |
GA | 1.34 | – |
PodSchedulingReadiness |
false |
Alpha | 1.26 | 1.26 |
PodSchedulingReadiness |
true |
Beta | 1.27 | 1.29 |
PodSchedulingReadiness |
true |
GA | 1.30 | – |
RecoverVolumeExpansionFailure |
false |
Alpha | 1.23 | 1.31 |
RecoverVolumeExpansionFailure |
true |
Beta | 1.32 | 1.33 |
RecoverVolumeExpansionFailure |
true |
GA | 1.34 | – |
RecursiveReadOnlyMounts |
false |
Alpha | 1.30 | 1.30 |
RecursiveReadOnlyMounts |
true |
Beta | 1.31 | 1.32 |
RecursiveReadOnlyMounts |
true |
GA | 1.33 | – |
RelaxedDNSSearchValidation |
false |
Alpha | 1.32 | 1.32 |
RelaxedDNSSearchValidation |
true |
Beta | 1.33 | 1.33 |
RelaxedDNSSearchValidation |
true |
GA | 1.34 | – |
RelaxedEnvironmentVariableValidation |
false |
Alpha | 1.30 | 1.31 |
RelaxedEnvironmentVariableValidation |
true |
Beta | 1.32 | 1.33 |
RelaxedEnvironmentVariableValidation |
true |
GA | 1.34 | – |
ResilientWatchCacheInitialization |
true |
Beta | 1.31 | 1.33 |
ResilientWatchCacheInitialization |
true |
GA | 1.34 | – |
RetryGenerateName |
false |
Alpha | 1.30 | 1.30 |
RetryGenerateName |
true |
Beta | 1.31 | 1.31 |
RetryGenerateName |
true |
GA | 1.32 | – |
SchedulerQueueingHints |
true |
Beta | 1.28 | 1.28 |
SchedulerQueueingHints |
false |
Beta | 1.29 | 1.31 |
SchedulerQueueingHints |
true |
Beta | 1.32 | 1.33 |
SchedulerQueueingHints |
true |
GA | 1.34 | – |
SeparateCacheWatchRPC |
true |
Beta | 1.28 | 1.32 |
SeparateCacheWatchRPC |
false |
Deprecated | 1.33 | – |
SeparateTaintEvictionController |
true |
Beta | 1.29 | 1.33 |
SeparateTaintEvictionController |
true |
GA | 1.34 | – |
ServiceAccountTokenJTI |
false |
Alpha | 1.29 | 1.29 |
ServiceAccountTokenJTI |
true |
Beta | 1.30 | 1.31 |
ServiceAccountTokenJTI |
true |
GA | 1.32 | – |
ServiceAccountTokenNodeBinding |
false |
Alpha | 1.29 | 1.30 |
ServiceAccountTokenNodeBinding |
true |
Beta | 1.31 | 1.32 |
ServiceAccountTokenNodeBinding |
true |
GA | 1.33 | – |
ServiceAccountTokenNodeBindingValidation |
false |
Alpha | 1.29 | 1.29 |
ServiceAccountTokenNodeBindingValidation |
true |
Beta | 1.30 | 1.31 |
ServiceAccountTokenNodeBindingValidation |
true |
GA | 1.32 | – |
ServiceAccountTokenPodNodeInfo |
false |
Alpha | 1.29 | 1.29 |
ServiceAccountTokenPodNodeInfo |
true |
Beta | 1.30 | 1.31 |
ServiceAccountTokenPodNodeInfo |
true |
GA | 1.32 | – |
ServiceTrafficDistribution |
false |
Alpha | 1.30 | 1.30 |
ServiceTrafficDistribution |
true |
Beta | 1.31 | 1.32 |
ServiceTrafficDistribution |
true |
GA | 1.33 | – |
SidecarContainers |
false |
Alpha | 1.28 | 1.28 |
SidecarContainers |
true |
Beta | 1.29 | 1.32 |
SidecarContainers |
true |
GA | 1.33 | – |
SizeMemoryBackedVolumes |
false |
Alpha | 1.20 | 1.21 |
SizeMemoryBackedVolumes |
true |
Beta | 1.22 | 1.31 |
SizeMemoryBackedVolumes |
true |
GA | 1.32 | – |
StatefulSetAutoDeletePVC |
false |
Alpha | 1.23 | 1.26 |
StatefulSetAutoDeletePVC |
true |
Beta | 1.27 | 1.31 |
StatefulSetAutoDeletePVC |
true |
GA | 1.32 | – |
StatefulSetStartOrdinal |
false |
Alpha | 1.26 | 1.26 |
StatefulSetStartOrdinal |
true |
Beta | 1.27 | 1.30 |
StatefulSetStartOrdinal |
true |
GA | 1.31 | – |
StorageNamespaceIndex |
true |
Beta | 1.30 | 1.32 |
StorageNamespaceIndex |
true |
Deprecated | 1.33 | – |
StreamingCollectionEncodingToJSON |
true |
Beta | 1.33 | 1.33 |
StreamingCollectionEncodingToJSON |
true |
GA | 1.34 | – |
StreamingCollectionEncodingToProtobuf |
true |
Alpha | 1.33 | 1.33 |
StreamingCollectionEncodingToProtobuf |
true |
GA | 1.34 | – |
StrictCostEnforcementForVAP |
false |
Beta | 1.30 | 1.31 |
StrictCostEnforcementForVAP |
true |
GA | 1.32 | – |
StrictCostEnforcementForWebhooks |
false |
Beta | 1.31 | 1.31 |
StrictCostEnforcementForWebhooks |
true |
GA | 1.32 | – |
StructuredAuthenticationConfiguration |
false |
Alpha | 1.29 | 1.29 |
StructuredAuthenticationConfiguration |
true |
Beta | 1.30 | 1.33 |
StructuredAuthenticationConfiguration |
true |
GA | 1.34 | – |
StructuredAuthorizationConfiguration |
false |
Alpha | 1.29 | 1.29 |
StructuredAuthorizationConfiguration |
true |
Beta | 1.30 | 1.31 |
StructuredAuthorizationConfiguration |
true |
GA | 1.32 | – |
TopologyAwareHints |
false |
Alpha | 1.21 | 1.22 |
TopologyAwareHints |
false |
Beta | 1.23 | 1.23 |
TopologyAwareHints |
true |
Beta | 1.24 | 1.32 |
TopologyAwareHints |
true |
GA | 1.33 | – |
TopologyManagerPolicyOptions |
false |
Alpha | 1.26 | 1.27 |
TopologyManagerPolicyOptions |
true |
Beta | 1.28 | 1.31 |
TopologyManagerPolicyOptions |
true |
GA | 1.32 | – |
VolumeAttributesClass |
false |
Alpha | 1.29 | 1.30 |
VolumeAttributesClass |
false |
Beta | 1.31 | 1.33 |
VolumeAttributesClass |
true |
GA | 1.34 | – |
WatchFromStorageWithoutResourceVersion |
false |
Beta | 1.30 | 1.32 |
WatchFromStorageWithoutResourceVersion |
false |
Deprecated | 1.33 | – |
WindowsHostNetwork |
true |
Alpha | 1.26 | 1.32 |
WindowsHostNetwork |
false |
Deprecated | 1.33 | – |
WinDSR |
false |
Alpha | 1.14 | 1.32 |
WinDSR |
true |
Beta | 1.33 | 1.33 |
WinDSR |
true |
GA | 1.34 | – |
WinOverlay |
false |
Alpha | 1.14 | 1.19 |
WinOverlay |
true |
Beta | 1.20 | 1.33 |
WinOverlay |
true |
GA | 1.34 | – |
Using a feature
Feature stages
A feature can be in Alpha, Beta or GA stage. An Alpha feature means:
- Disabled by default.
- Might be buggy. Enabling the feature may expose bugs.
- Support for feature may be dropped at any time without notice.
- The API may change in incompatible ways in a later software release without notice.
- Recommended for use only in short-lived testing clusters, due to increased risk of bugs and lack of long-term support.
A Beta feature means:
- Usually enabled by default. Beta API groups are disabled by default.
- The feature is well tested. Enabling the feature is considered safe.
- Support for the overall feature will not be dropped, though details may change.
- The schema and/or semantics of objects may change in incompatible ways in a subsequent beta or stable release. When this happens, we will provide instructions for migrating to the next version. This may require deleting, editing, and re-creating API objects. The editing process may require some thought. This may require downtime for applications that rely on the feature.
- Recommended for only non-business-critical uses because of potential for incompatible changes in subsequent releases. If you have multiple clusters that can be upgraded independently, you may be able to relax this restriction.
Note:
Please do try Beta features and give feedback on them! After they exit beta, it may not be practical for us to make more changes.A General Availability (GA) feature is also referred to as a stable feature. It means:
- The feature is always enabled; you cannot disable it.
- The corresponding feature gate is no longer needed.
- Stable versions of features will appear in released software for many subsequent versions.
List of feature gates
Each feature gate is designed for enabling/disabling a specific feature.
AllowDNSOnlyNodeCSRAllow kubelet to request a certificate without any Node IP available, only with DNS names.
AllowInsecureKubeletCertificateSigningRequestsDisable node admission validation of CertificateSigningRequests for kubelet signers. Unless you disable this feature gate, Kubernetes enforces that new kubelet certificates have a
commonNamematchingsystem:node:$nodeName.AllowParsingUserUIDFromCertAuthWhen this feature is enabled, the subject name attribute
1.3.6.1.4.1.57683.2in an X.509 certificate will be parsed as the user UID during certificate authentication.AllowServiceLBStatusOnNonLBEnables
.status.ingress.loadBalancerto be set on Services of types other thanLoadBalancer.AllowUnsafeMalformedObjectDeletionEnables the cluster operator to identify corrupt resource(s) using the list operation, and introduces an option
ignoreStoreReadErrorWithClusterBreakingPotentialthat the operator can set to perform unsafe and force delete operation of such corrupt resource(s) using the Kubernetes API.AnonymousAuthConfigurableEndpointsEnable configurable endpoints for anonymous auth for the API server.
AnyVolumeDataSourceEnable use of any custom resource as the
DataSourceof a PVC.APIResponseCompressionCompress the API responses for
LISTorGETrequests.APIServerIdentityAssign each API server an ID in a cluster, using a Lease.
APIServerTracingAdd support for distributed tracing in the API server. See Traces for Kubernetes System Components for more details.
APIServingWithRoutineThis feature gate enables an API server performance improvement: the API server can use separate goroutines (lightweight threads managed by the Go runtime) to serve watch requests.
AuthorizeNodeWithSelectorsMake the Node authorizer use fine-grained selector authorization.
AuthorizeWithSelectorsAllows authorization to use field and label selectors. Enables
fieldSelectorandlabelSelectorfields in the SubjectAccessReview API, passes field and label selector information to authorization webhooks, enablesfieldSelectorandlabelSelectorfunctions in the authorizer CEL library, and enables checkingfieldSelectorandlabelSelectorfields in authorization webhookmatchConditions.BtreeWatchCacheWhen enabled, the API server will replace the legacy HashMap-based watch cache with a BTree-based implementation. This replacement may bring performance improvements.
CBORServingAndStorageEnables CBOR as a supported encoding for requests and responses, and as the preferred storage encoding for custom resources.
ClearingNominatedNodeNameAfterBindingEnable clearing
.status.nominatedNodeNamewhenever Pods are bound to nodes.CloudControllerManagerWebhookEnable webhooks in cloud controller manager.
ClusterTrustBundleEnable ClusterTrustBundle objects and kubelet integration.
ClusterTrustBundleProjectionComponentFlagzEnables the component's flagz endpoint. See zpages for more information.
ComponentSLIsEnable the
/metrics/slisendpoint on Kubernetes components like kubelet, kube-scheduler, kube-proxy, kube-controller-manager, cloud-controller-manager allowing you to scrape health check metrics.ComponentStatuszEnables the component's statusz endpoint. See zpages for more information.
ConcurrentWatchObjectDecodeEnable concurrent watch object decoding. This is to avoid starving the API server's watch cache when a conversion webhook is installed.
ConsistentListFromCacheEnhance Kubernetes API server performance by serving consistent list requests directly from its watch cache, improving scalability and response times. To consistent list from cache Kubernetes requires a newer etcd version (v3.4.31+ or v3.5.13+), that includes fixes to watch progress request feature. If older etcd version is provided Kubernetes will automatically detect it and fallback to serving consistent reads from etcd. Progress notifications ensure watch cache is consistent with etcd while reducing the need for resource-intensive quorum reads from etcd.
See the Kubernetes documentation on Semantics for get and list for more details.
ContainerCheckpointEnables the kubelet
checkpointAPI. See Kubelet Checkpoint API for more details.ContainerRestartRulesEnables the ability to configure container-level restart policy and restart rules. See Container Restart Policy and Rules for more details.
ContainerStopSignalsEnables usage of the StopSignal lifecycle for containers for configuring custom stop signals using which the containers would be stopped.
ContextualLoggingEnables extra details in log output of Kubernetes components that support contextual logging.
CoordinatedLeaderElectionEnables the behaviors supporting the LeaseCandidate API, and also enables coordinated leader election for the Kubernetes control plane, deterministically.
CPUManagerPolicyAlphaOptionsThis allows fine-tuning of CPUManager policies, experimental, Alpha-quality options This feature gate guards a group of CPUManager options whose quality level is alpha. This feature gate will never graduate to beta or stable.
CPUManagerPolicyBetaOptionsThis allows fine-tuning of CPUManager policies, experimental, Beta-quality options This feature gate guards a group of CPUManager options whose quality level is beta. This feature gate will never graduate to stable.
CPUManagerPolicyOptionsAllow fine-tuning of CPUManager policies.
CRDValidationRatchetingEnable updates to custom resources to contain violations of their OpenAPI schema if the offending portions of the resource update did not change. See Validation Ratcheting for more details.
CronJobsScheduledAnnotationSet the scheduled job time as an annotation on Jobs that were created on behalf of a CronJob.
CrossNamespaceVolumeDataSourceEnable the usage of cross namespace volume data source to allow you to specify a source namespace in the
dataSourceReffield of a PersistentVolumeClaim.CSIMigrationPortworxEnables shims and translation logic to route volume operations from the Portworx in-tree plugin to Portworx CSI plugin. Requires Portworx CSI driver to be installed and configured in the cluster.
CSIVolumeHealthEnable support for CSI volume health monitoring on node.
CustomCPUCFSQuotaPeriodEnable nodes to change
cpuCFSQuotaPeriodin kubelet config.CustomResourceFieldSelectorsEnable
selectableFieldsin the CustomResourceDefinition API to allow filtering of custom resource list, watch and deletecollection requests.DeclarativeValidationEnables declarative validation of in-tree Kubernetes APIs. When enabled, APIs with declarative validation rules (defined using IDL tags in the Go code) will have both the generated declarative validation code and the original hand-written validation code executed. The results are compared, and any discrepancies are reported via the
declarative_validation_mismatch_totalmetric. Only the hand-written validation result is returned to the user (eg: actually validates in the request path). The original hand-written validation are still the authoritative validations when this is enabled but this can be changed if the DeclarativeValidationTakeover feature gate is enabled in addition to this gate. This feature gate only operates on the kube-apiserver.DeclarativeValidationTakeoverWhen enabled, along with the DeclarativeValidation feature gate, declarative validation errors are returned directly to the caller, replacing hand-written validation errors for rules that have declarative implementations. When disabled (and
DeclarativeValidationis enabled), hand-written validation errors are always returned, effectively putting declarative validation in a mismatch validation mode that monitors but does not affect API responses. This mismatch validation mode allows for the monitoring of thedeclarative_validation_mismatch_totalanddeclarative_validation_panic_totalmetrics which are implementation details for a safer rollout, average user shouldn't need to interact with it directly. This feature gate only operates on the kube-apiserver. Note: Although declarative validation aims for functional equivalence with hand-written validation, the exact description of error messages may differ between the two approaches.DeploymentReplicaSetTerminatingReplicasEnables a new status field
.status.terminatingReplicasin Deployments and ReplicaSets to allow tracking of terminating pods.DetectCacheInconsistencyEnable cache inconsistency detection in the API server.
DisableAllocatorDualWriteYou can enable the
MultiCIDRServiceAllocatorfeature gate. The API server supports migration from the old bitmap ClusterIP allocators to the new IPAddress allocators.The API server performs a dual-write on both allocators. This feature gate disables the dual write on the new Cluster IP allocators; you can enable this feature gate if you have completed the relevant stage of the migration.
DisableNodeKubeProxyVersionDisable setting the
kubeProxyVersionfield of the Node.DRAAdminAccessEnables support for requesting admin access in a ResourceClaim or a ResourceClaimTemplate. Admin access grants access to in-use devices and may enable additional permissions when making the device available in a container. Starting with Kubernetes v1.33, only users authorized to create ResourceClaim or ResourceClaimTemplate objects in namespaces labeled with
resource.kubernetes.io/admin-access: "true"(case-sensitive) can use theadminAccessfield. This ensures that non-admin users cannot misuse the feature. Starting with Kubernetes v1.34, this label has been updated toresource.kubernetes.io/admin-access: "true".This feature gate has no effect unless you also enable the
DynamicResourceAllocationfeature gate.DRAConsumableCapacityEnables device sharing across multiple ResourceClaims or requests.
Additionally, if a device supports sharing, its resource (capacity) can be managed through a defined sharing policy.
DRADeviceBindingConditionsEnables support for DeviceBindingConditions in the DRA related fields. This allows for thorough device readiness checks and attachment processes before Bind phase.
DRADeviceTaintsEnables support for tainting devices and selectively tolerating those taints when using dynamic resource allocation to manage devices.
This feature gate has no effect unless you also enable the
DynamicResourceAllocationfeature gate.DRAExtendedResourceEnables support for the Extended Resource allocation by DRA feature. It makes it possible to specify an extended resource name in a DeviceClass.
This feature gate has no effect unless the
DynamicResourceAllocationfeature gate is enabled.DRAPartitionableDevicesEnables support for requesting Partitionable Devices for DRA. This lets drivers advertise multiple devices that maps to the same resources of a physical device.
This feature gate has no effect unless you also enable the
DynamicResourceAllocationfeature gate.DRAPrioritizedListEnables support for the Prioritized List feature. It makes it possible to specify a prioritized list of subrequests for requests in a ResourceClaim.
This feature gate has no effect unless you also enable the
DynamicResourceAllocationfeature gate.DRAResourceClaimDeviceStatusEnables support the ResourceClaim.status.devices field and for setting this status from DRA drivers. It requires the
DynamicResourceAllocationfeature gate to be enabled.DRASchedulerFilterTimeoutEnables aborting the per-node filter operation in the scheduler after a certain time (10 seconds by default, configurable in the DynamicResources scheduler plugin configuration).
DynamicResourceAllocationEnables support for resources with custom parameters and a lifecycle that is independent of a Pod. Allocation of resources is handled by the Kubernetes scheduler based on "structured parameters".
ElasticIndexedJobEnables Indexed Jobs to be scaled up or down by mutating both
spec.completionsandspec.parallelismtogether such thatspec.completions == spec.parallelism. See docs on elastic Indexed Jobs for more details.EnvFilesSupport defining container's Environment Variable Values via File. See Define Environment Variable Values Using An Init Container for more details.
EventedPLEGEnable support for the kubelet to receive container life cycle events from the container runtime via an extension to CRI. (PLEG is an abbreviation for “Pod lifecycle event generator”). For this feature to be useful, you also need to enable support for container lifecycle events in each container runtime running in your cluster. If the container runtime does not announce support for container lifecycle events then the kubelet automatically switches to the legacy generic PLEG mechanism, even if you have this feature gate enabled.
ExecProbeTimeoutEnsure kubelet respects exec probe timeouts. This feature gate exists in case any of your existing workloads depend on a now-corrected fault where Kubernetes ignored exec probe timeouts. See readiness probes.
ExternalServiceAccountTokenSignerEnable setting
--service-account-signing-endpointto make the kube-apiserver use external signer for token signing and token verifying key management.GitRepoVolumeDriverThis controls if the
gitRepovolume plugin is supported or not. ThegitRepovolume plugin is disabled by default starting v1.33 release. This provides a way for users to enable it.GracefulNodeShutdownEnables support for graceful shutdown in kubelet. During a system shutdown, kubelet will attempt to detect the shutdown event and gracefully terminate pods running on the node. See Graceful Node Shutdown for more details.
GracefulNodeShutdownBasedOnPodPriorityEnables the kubelet to check Pod priorities when shutting down a node gracefully.
HonorPVReclaimPolicyHonor persistent volume reclaim policy when it is
Deleteirrespective of PV-PVC deletion ordering. For more details, check the PersistentVolume deletion protection finalizer documentation.HostnameOverrideAllows setting any FQDN as the pod's hostname.
HPAConfigurableToleranceEnables setting a tolerance threshold for HorizontalPodAutoscaler metrics.
HPAScaleToZeroEnables setting
minReplicasto 0 forHorizontalPodAutoscalerresources when using custom or external metrics.ImageMaximumGCAgeEnables the kubelet configuration field
imageMaximumGCAge, allowing an administrator to specify the age after which an image will be garbage collected.ImageVolumeAllow using the
imagevolume source in a Pod. This volume source lets you mount a container image as a read-only volume.InformerResourceVersionEnables the check over the last synced resource version using the informer.
InOrderInformersForce the informers to deliver watch stream events in order instead of out of order.
InPlacePodVerticalScalingEnables in-place Pod vertical scaling.
InPlacePodVerticalScalingAllocatedStatusEnables the
allocatedResourcesfield in the container status. This feature requires theInPlacePodVerticalScalinggate be enabled as well.InPlacePodVerticalScalingExclusiveCPUsEnable resource resizing for containers in Guaranteed pods with integer CPU requests. It applies only in nodes with
InPlacePodVerticalScalingandCPUManagerfeatures enabled, and the CPUManager policy set tostatic.InPlacePodVerticalScalingExclusiveMemoryAllow resource resize for containers in Guaranteed Pods when the memory manager policy is set to
"Static". Applies only to nodes withInPlacePodVerticalScalingand memory manager features enabled.InTreePluginPortworxUnregisterStops registering the Portworx in-tree plugin in kubelet and volume controllers.
JobBackoffLimitPerIndexAllows specifying the maximal number of pod retries per index in Indexed jobs.
JobManagedByAllows to delegate reconciliation of a Job object to an external controller.
JobPodReplacementPolicyAllows you to specify pod replacement for terminating pods in a Job
JobSuccessPolicyAllow users to specify when a Job can be declared as succeeded based on the set of succeeded pods.
KMSv1Enables KMS v1 API for encryption at rest. See Using a KMS Provider for data encryption for more details.
KubeletCgroupDriverFromCRIEnable detection of the kubelet cgroup driver configuration option from the CRI. This feature gate is now on for all clusters. However, it only works on nodes where there is a CRI container runtime that supports the
RuntimeConfigCRI call. If the CRI supports this feature, the kubelet ignores thecgroupDriverconfiguration setting (or deprecated--cgroup-drivercommand line argument). If the container runtime doesn't support it, the kubelet falls back to using the driver configured using thecgroupDriverconfiguration setting. The kubelet will stop falling back to this configuration in Kubernetes 1.36. Thus, users must upgrade their CRI container runtime to a version that supports theRuntimeConfigCRI call by then. Admins can use the metrickubelet_cri_losing_supportto see if there are any nodes in their cluster that will lose support in 1.36. The following CRI versions support this CRI call:- containerd: Support was added in v2.0.0
- CRI-O: Support was added in v1.28.0
See Configuring a cgroup driver for more details.
KubeletCrashLoopBackOffMaxEnables support for configurable per-node backoff maximums for restarting containers in the
CrashLoopBackOffstate. For more details, check thecrashLoopBackOff.maxContainerRestartPeriodfield in the kubelet config file.KubeletEnsureSecretPulledImagesEnsure that pods requesting an image are authorized to access the image with the provided credentials when the image is already present on the node. See Ensure Image Pull Credential Verification.
KubeletFineGrainedAuthzEnable fine-grained authorization for the kubelet's HTTP(s) API.
KubeletInUserNamespaceEnables support for running kubelet in a user namespace. See Running Kubernetes Node Components as a Non-root User.
KubeletPodResourcesDynamicResourcesExtend the kubelet's pod resources monitoring gRPC API endpoints List and Get to include resources allocated in ResourceClaims via Dynamic Resource Allocation.
KubeletPodResourcesGetEnable the
GetgRPC endpoint on kubelet's for Pod resources. This API augments the resource allocation reporting.KubeletPSIEnable kubelet to surface Pressure Stall Information (PSI) metrics in the Summary API and Prometheus metrics.
KubeletSeparateDiskGCThe split image filesystem feature enables kubelet to perform garbage collection of images (read-only layers) and/or containers (writeable layers) deployed on separate filesystems.
KubeletServiceAccountTokenForCredentialProvidersEnable kubelet to send the service account token bound to the pod for which the image is being pulled to the credential provider plugin.
KubeletTracingAdd support for distributed tracing in the kubelet. When enabled, kubelet CRI interface and authenticated http servers are instrumented to generate OpenTelemetry trace spans. See Traces for Kubernetes System Components for more details.
ListFromCacheSnapshotEnables the API server to generate snapshots for the watch cache store and using them to serve LIST requests.
LoadBalancerIPModeAllows setting
ipModefor Services wheretypeis set toLoadBalancer. See Specifying IPMode of load balancer status for more information.LocalStorageCapacityIsolationFSQuotaMonitoringWhen
LocalStorageCapacityIsolationis enabled for local ephemeral storage, the backing filesystem for emptyDir volumes supports project quotas, andUserNamespacesSupportis enabled, project quotas are used to monitoremptyDirvolume storage consumption rather than using filesystem walk, ensuring better performance and accuracy.LogarithmicScaleDownEnable semi-random selection of pods to evict on controller scaledown based on logarithmic bucketing of pod timestamps.
LoggingAlphaOptionsAllow fine-tuning of experimental, alpha-quality logging options.
LoggingBetaOptionsAllow fine-tuning of experimental, beta-quality logging options.
MatchLabelKeysInPodAffinityEnable the
matchLabelKeysandmismatchLabelKeysfields for pod (anti)affinity.MatchLabelKeysInPodTopologySpreadEnable the
matchLabelKeysfield for Pod topology spread constraints.MatchLabelKeysInPodTopologySpreadSelectorMergeEnable merging of selectors built from
matchLabelKeysintolabelSelectorof Pod topology spread constraints. This feature gate can be enabled whenmatchLabelKeysfeature is enabled with theMatchLabelKeysInPodTopologySpreadfeature flag.Enables setting the
maxUnavailablefield for the rolling update strategy of a StatefulSet. The field specifies the maximum number of Pods that can be unavailable during the update.MemoryManagerAllows setting memory affinity for a container based on NUMA topology.
MemoryQoSEnable memory protection and usage throttle on pod / container using cgroup v2 memory controller.
MultiCIDRServiceAllocatorTrack IP address allocations for Service cluster IPs using IPAddress objects.
MutableCSINodeAllocatableCountWhen this feature gate is enabled, the
.spec.drivers[*].allocatable.countfield of a CSINode becomes mutable, and a new field,nodeAllocatableUpdatePeriodSeconds, is available in the CSIDriver object. This allows periodic updates to a node's reported allocatable volume capacity, preventing stateful pods from becoming stuck due to outdated information that the kube-scheduler relies on.MutatingAdmissionPolicyEnable MutatingAdmissionPolicy support, which allows CEL mutations to be applied during admission control.
For Kubernetes v1.30 and v1.31, this feature gate existed but had no effect.
NFTablesProxyModeAllow running kube-proxy in nftables mode.
NodeInclusionPolicyInPodTopologySpreadEnable using
nodeAffinityPolicyandnodeTaintsPolicyin Pod topology spread constraints when calculating pod topology spread skew.NodeLogQueryEnables querying logs of node services using the
/logsendpoint.NodeSwapEnable the kubelet to allocate swap memory for Kubernetes workloads on a node. Must be used with
KubeletConfiguration.failSwapOnset to false. For more details, please see swap memoryNominatedNodeNameForExpectationWhen enabled, the kube-scheduler uses
.status.nominatedNodeNameto express where a Pod is going to be bound. External components can also write to.status.nominatedNodeNamefor a Pod to provide a suggested placement.OpenAPIEnumsEnables populating "enum" fields of OpenAPI schemas in the spec returned from the API server.
OrderedNamespaceDeletionWhile deleting namespace, the pods resources is going to be deleted before the rest of resources.
PodAndContainerStatsFromCRIConfigure the kubelet to gather container and pod stats from the CRI container runtime rather than gathering them from cAdvisor. As of 1.26, this also includes gathering metrics from CRI and emitting them over
/metrics/cadvisor(rather than having cAdvisor emit them directly).PodCertificateRequestEnable PodCertificateRequest objects and podCertificate projected volume sources.
PodDeletionCostEnable the Pod Deletion Cost feature which allows users to influence ReplicaSet downscaling order.
PodIndexLabelEnables the Job controller and StatefulSet controller to add the pod index as a label when creating new pods. See Job completion mode docs and StatefulSet pod index label docs for more details.
PodLevelResourcesEnable Pod level resources: the ability to specify resource requests and limits at the Pod level, rather than only for specific containers.
PodLifecycleSleepActionEnables the
sleepaction in Container lifecycle hooks (preStopandpostStart).PodLifecycleSleepActionAllowZeroEnables setting zero value for the
sleepaction in container lifecycle hooks.PodLogsQuerySplitStreamsEnable fetching specific log streams (either stdout or stderr) from a container's log streams, using the Pod API.
PodObservedGenerationTrackingEnables the kubelet to set
observedGenerationin the Pod.status, and enables other components to setobservedGenerationin pod conditions. This feature allows reflecting the.metadata.generationof the Pod at the time that the overall status, or some specific condition, was being recorded. Storing it helps avoid risks associated with lost updates.PodReadyToStartContainersConditionEnable the kubelet to mark the PodReadyToStartContainers condition on pods.
This feature gate was previously known as
PodHasNetworkCondition, and the associated condition was namedPodHasNetwork.PodSchedulingReadinessEnable setting
schedulingGatesfield to control a Pod's scheduling readiness.PodTopologyLabelsAdmissionEnables the
PodTopologyLabelsadmission plugin. See Pod Topology Labels for details.PortForwardWebsocketsAllow WebSocket streaming of the portforward sub-protocol (
port-forward) from clients requesting version v2 (v2.portforward.k8s.io) of the sub-protocol.PreferSameTrafficDistributionAllows usage of the values
PreferSameZoneandPreferSameNodein the ServicetrafficDistributionfield.PreventStaticPodAPIReferencesDenies Pod admission if static Pods reference other API objects.
ProcMountTypeEnables control over the type proc mounts for containers by setting the
procMountfield of a Pod'ssecurityContext.QOSReservedAllows resource reservations at the QoS level preventing pods at lower QoS levels from bursting into resources requested at higher QoS levels (memory only for now).
RecoverVolumeExpansionFailureEnables users to edit their PVCs to smaller sizes so as they can recover from previously issued volume expansion failures. See Recovering from Failure when Expanding Volumes for more details.
RecursiveReadOnlyMountsEnables support for recursive read-only mounts. For more details, see read-only mounts.
ReduceDefaultCrashLoopBackOffDecayEnabled reduction of both the initial delay and the maximum delay accrued between container restarts for a node for containers in
CrashLoopBackOffacross the cluster to1sinitial delay and60smaximum delay.RelaxedDNSSearchValidationRelax the server side validation for the DNS search string (
.spec.dnsConfig.searches) for containers. For example, with this gate enabled, it is okay to include the_character in the DNS name search string.RelaxedEnvironmentVariableValidationAllow almost all printable ASCII characters in environment variables.
RelaxedServiceNameValidationEnables relaxed validation for Service object names, allowing the use of RFC 1123 label names instead of RFC 1035 label names.
This feature allows Service object names to start with a digit.
ReloadKubeletServerCertificateFileEnable the kubelet TLS server to update its certificate if the specified certificate file are changed.
This feature is useful when specifying
tlsCertFileandtlsPrivateKeyFilein kubelet configuration. The feature gate has no effect for other cases such as using TLS bootstrap.RemoteRequestHeaderUIDEnable the API server to accept UIDs (user IDs) via request header authentication. This will also make the
kube-apiserver's API aggregator add UIDs via standard headers when forwarding requests to the servers serving the aggregated API.ResilientWatchCacheInitializationEnables resilient watchcache initialization to avoid controlplane overload.
ResourceHealthStatusEnable the
allocatedResourcesStatusfield within the.statusfor a Pod. The field reports additional details for each container in the Pod, with the health information for each device assigned to the Pod.This feature applies to devices managed by both Device Plugins and Dynamic Resource Allocation. See Device plugin and unhealthy devices for more details.
RetryGenerateNameEnables retrying of object creation when the API server is expected to generate a name.
When this feature is enabled, requests using
generateNameare retried automatically in case the control plane detects a name conflict with an existing object, up to a limit of 8 total attempts.RotateKubeletServerCertificateEnable the rotation of the server TLS certificate on the kubelet. See kubelet configuration for more details.
RuntimeClassInImageCriApiEnables images to be pulled based on the runtime class of the pods that reference them.
SchedulerAsyncAPICallsChange the kube-scheduler to make the entire scheduling cycle free of blocking requests to the Kubernetes API server. Instead, interact with the Kubernetes API using asynchronous code.
SchedulerAsyncPreemptionEnable running some expensive operations within the scheduler, associated with preemption, asynchronously. Asynchronous processing of preemption improves overall Pod scheduling latency.
SchedulerPopFromBackoffQImproves scheduling queue behavior by popping pods from the backoffQ when the activeQ is empty. This allows to process potentially schedulable pods ASAP, eliminating a penalty effect of the backoff queue.
SchedulerQueueingHintsEnables scheduler queueing hints, which benefits to reduce the useless requeuing. The scheduler retries scheduling pods if something changes in the cluster that could make the pod scheduled. Queueing hints are internal signals that allow the scheduler to filter the changes in the cluster that are relevant to the unscheduled pod, based on previous scheduling attempts.
SELinuxChangePolicyEnables
spec.securityContext.seLinuxChangePolicyfield. This field can be used to opt-out from applying the SELinux label to the pod volumes using mount options. This is required when a single volume that supports mounting with SELinux mount option is shared between Pods that have different SELinux labels, such as a privileged and unprivileged Pods.Enabling the
SELinuxChangePolicyfeature gate requires the feature gateSELinuxMountReadWriteOncePodto be enabled.SELinuxMountSpeeds up container startup by allowing kubelet to mount volumes for a Pod directly with the correct SELinux label instead of changing each file on the volumes recursively. It widens the performance improvements behind the
SELinuxMountReadWriteOncePodfeature gate by extending the implementation to all volumes.Enabling the
SELinuxMountfeature gate requires the feature gatesSELinuxMountReadWriteOncePodandSELinuxChangePolicyto be enabled.SELinuxMountReadWriteOncePodSpeeds up container startup by allowing kubelet to mount volumes for a Pod directly with the correct SELinux label instead of changing each file on the volumes recursively. The initial implementation focused on ReadWriteOncePod volumes.
SeparateCacheWatchRPCAllows the API server watch cache to create a watch on a dedicated RPC. This prevents watch cache from being starved by other watches.
SeparateTaintEvictionControllerEnables running the taint based eviction controller, that performs Taint-based Evictions, as a standalone controller (separate from the node lifecycle controller).
ServiceAcccountNodeAudienceRestrictionThis gate is used to restrict the audience for which the kubelet can request a service account token for.
ServiceAccountTokenJTIControls whether JTIs (UUIDs) are embedded into generated service account tokens, and whether these JTIs are recorded into the Kubernetes audit log for future requests made by these tokens.
ServiceAccountTokenNodeBindingControls whether the API server allows binding service account tokens to Node objects.
ServiceAccountTokenNodeBindingValidationControls whether the apiserver will validate a Node reference in service account tokens.
ServiceAccountTokenPodNodeInfoControls whether the apiserver embeds the node name and uid for the associated node when issuing service account tokens bound to Pod objects.
ServiceTrafficDistributionAllows usage of the optional
spec.trafficDistributionfield in Services. The field offers a way to express preferences for how traffic is distributed to Service endpoints.SidecarContainersAllow setting the
restartPolicyof an init container toAlwaysso that the container becomes a sidecar container (restartable init containers). See Sidecar containers and restartPolicy for more details.SizeBasedListCostEstimateEnables APF to use size of objects for estimating request cost.
SizeMemoryBackedVolumesEnable kubelets to determine the size limit for memory-backed volumes (mainly
emptyDirvolumes).StatefulSetAutoDeletePVCAllows the use of the optional
.spec.persistentVolumeClaimRetentionPolicyfield, providing control over the deletion of PVCs in a StatefulSet's lifecycle. See PersistentVolumeClaim retention for more details.StatefulSetStartOrdinalAllow configuration of the start ordinal in a StatefulSet. See Start ordinal for more details.
StorageCapacityScoringThe feature gate
VolumeCapacityPrioritywas used in v1.32 to support storage that are statically provisioned. Starting from v1.33, the new feature gateStorageCapacityScoringreplaces the oldVolumeCapacityPrioritygate with added support to dynamically provisioned storage. WhenStorageCapacityScoringis enabled, the VolumeBinding plugin in the kube-scheduler is extended to score Nodes based on the storage capacity on each of them. This feature is applicable to CSI volumes that supported Storage Capacity, including local storage backed by a CSI driver.StorageNamespaceIndexEnables a namespace indexer for namespace scoped resources in API server cache to accelerate list operations.
StorageVersionAPIEnable the storage version API.
StorageVersionHashAllow API servers to expose the storage version hash in the discovery.
StorageVersionMigratorEnables storage version migration. See Migrate Kubernetes Objects Using Storage Version Migration for more details.
StreamingCollectionEncodingToJSONAllow the API server JSON encoder to encode collections item by item, instead of all at once.
StreamingCollectionEncodingToProtobufAllow the API server Protobuf encoder to encode collections item by item, instead of all at once.
StrictCostEnforcementForVAPApply strict CEL cost validation for ValidatingAdmissionPolicies.
StrictCostEnforcementForWebhooksApply strict CEL cost validation for
matchConditionswithin admission webhooks.StrictIPCIDRValidationUse stricter validation for fields containing IP addresses and CIDR values.
In particular, with this feature gate enabled, octets within IPv4 addresses are not allowed to have any leading
0s, and IPv4-mapped IPv6 values (e.g.::ffff:192.168.0.1) are forbidden. These sorts of values can potentially cause security problems when different components interpret the same string as referring to different IP addresses (as in CVE-2021-29923).This tightening applies only to fields in build-in API kinds, and not to custom resource kinds, values in Kubernetes configuration files, or command-line arguments.
StructuredAuthenticationConfigurationEnable structured authentication configuration for the API server.
StructuredAuthenticationConfigurationEgressSelectorEnables Egress Selector in Structured Authentication Configuration.
StructuredAuthorizationConfigurationEnable structured authorization configuration, so that cluster administrators can specify more than one authorization webhook in the API server handler chain.
SupplementalGroupsPolicyEnables support for fine-grained SupplementalGroups control. For more details, see Configure fine-grained SupplementalGroups control for a Pod.
SystemdWatchdogAllow using systemd watchdog to monitor the health status of kubelet. See Kubelet Systemd Watchdog for more details.
TokenRequestServiceAccountUIDValidationThis is used to ensure that the UID provided in the TokenRequest matches the UID of the ServiceAccount for which the token is being requested. It helps prevent misuse of the TokenRequest API by ensuring that tokens are only issued for the correct ServiceAccount.
TopologyAwareHintsEnables topology aware routing based on topology hints in EndpointSlices. See Topology Aware Hints for more details.
TopologyManagerPolicyAlphaOptionsAllow fine-tuning of topology manager policies, experimental, Alpha-quality options. This feature gate guards a group of topology manager options whose quality level is alpha. This feature gate will never graduate to beta or stable.
TopologyManagerPolicyBetaOptionsAllow fine-tuning of topology manager policies, experimental, Beta-quality options. This feature gate guards a group of topology manager options whose quality level is beta. This feature gate will never graduate to stable.
TopologyManagerPolicyOptionsEnable fine-tuning of topology manager policies.
TranslateStreamCloseWebsocketRequestsAllow WebSocket streaming of the remote command sub-protocol (
exec,cp,attach) from clients requesting version 5 (v5) of the sub-protocol.UnauthenticatedHTTP2DOSMitigationEnables HTTP/2 Denial of Service (DoS) mitigations for unauthenticated clients. Kubernetes v1.28.0 through v1.28.2 do not include this feature gate.
UnknownVersionInteroperabilityProxyProxy resource requests to the correct peer kube-apiserver when multiple kube-apiservers exist at varied versions. See Mixed version proxy for more information.
UserNamespacesPodSecurityStandardsEnable Pod Security Standards policies relaxation for pods that run with namespaces. You must set the value of this feature gate consistently across all nodes in your cluster, and you must also enable
UserNamespacesSupportto use this feature.UserNamespacesSupportEnable user namespace support for Pods.
VolumeAttributesClassEnable support for VolumeAttributesClasses. See Volume Attributes Classes for more information.
WatchCacheInitializationPostStartHookEnables post-start-hook for watchcache initialization to be part of readyz (with timeout).
WatchFromStorageWithoutResourceVersionEnables watches without
resourceVersionto be served from storage.WatchListEnable support for streaming initial state of objects in watch requests.
WatchListClientAllows an API client to request a stream of data rather than fetching a full list. This functionality is available in
client-goand requires the WatchList feature to be enabled on the server. If theWatchListis not supported on the server, the client will seamlessly fall back to a standard list request.WindowsCPUAndMemoryAffinityAdd CPU and Memory Affinity support to Windows nodes with CPUManager, MemoryManager and topology manager.
WindowsGracefulNodeShutdownEnables support for windows node graceful shutdown in kubelet. During a system shutdown, kubelet will attempt to detect the shutdown event and gracefully terminate pods running on the node. See Graceful Node Shutdown for more details.
WindowsHostNetworkEnables support for joining Windows containers to a hosts' network namespace.
WinDSRAllows kube-proxy to create DSR loadbalancers for Windows.
WinOverlayAllows kube-proxy to run in overlay mode for Windows.
What's next
- The deprecation policy for Kubernetes explains the project's approach to removing features and components.
- Since Kubernetes 1.24, new beta APIs are not enabled by default. When enabling a beta
feature, you will also need to enable any associated API resources.
For example, to enable a particular resource like
storage.k8s.io/v1beta1/csistoragecapacities, set--runtime-config=storage.k8s.io/v1beta1/csistoragecapacities. See API Versioning for more details on the command line flags.