DataProc cluster is in the Unknown state immediately after creation
Written by
Updated at December 16, 2024
Issue description
When you create a DataProc cluster, its nodes remain in the Unknown state immediately after creation
Solution
The cluster can be in the UNKNOWN state because its instances are created without public IP addresses
They are not available from the internet and do not have internet access by default.
To grant online access to these instances, use the NAT gateway functionality.
- Create a NAT gateway.
- Add a routing table by selecting the created gateway as a NextHop node.
- Link the routing table to the subnet with the cluster's instances:
- Set up security groups if required.
If you do not use security groups, skip this step.
As a result of these actions, the cluster should change to Running within several minutes.
If the issue persists
If the above actions didn't help, create a request for support
In the request, specify the following information:
- ID of the problem DataProc cluster.
- Date and time when the cluster creation started.