AWS has made an announcement regarding the general availability of AWS Glue Usage Profiles, a new feature that allows administrators to control the costs associated with their Glue jobs and Notebook sessions. This capability enables administrators to establish limits and controls on the resources utilized by different types of users. This means that administrators can create distinct cost profiles for various classes of users, each with its own set of parameters. For instance, a production pipeline data engineer might have a cost profile with unlimited worker capabilities, whereas a test user might have restrictions on the number of workers allowed.
To make use of AWS Glue Usage Profiles, administrators can start by creating a new usage profile through the AWS Glue Studio console or by utilizing the Glue Usage Profiles API. Once the profile is created, it can be assigned to a specific IAM user or role. Subsequently, any new Glue jobs or sessions initiated by that user or role will adhere to the limits specified within the assigned usage profile.
This new feature provides administrators with greater flexibility and control over the costs associated with AWS Glue jobs and Notebook sessions. By creating distinct cost profiles for different classes of users, administrators can effectively manage resource consumption and prevent unexpected expenditure. This capability is particularly valuable in environments where multiple users with varying resource requirements are utilizing AWS Glue services.
Overall, AWS Glue Usage Profiles offer a proactive approach to cost control, allowing administrators to set preemptive limits on resource consumption. This feature simplifies the management of AWS Glue costs by enabling administrators to tailor resource limits to the specific needs of different user groups. With the general availability of AWS Glue Usage Profiles, administrators now have a powerful tool at their disposal to ensure cost-effective usage of AWS Glue services.
Article Source
https://aws.amazon.com/about-aws/whats-new/2024/06/aws-glue-usage-profiles-now-generally-available