--- title: AWS Cloud Financial Management for Builders tags: Resources, Talk description: Resources to support the DevOps Engineering on on AWS course --- # AWS Cloud Financial Management for Builders ![](https://i.imgur.com/KPL21LH.jpg) Instructor: Scott Jones Email: scojoe@amazon.com ### :pushpin: Bookmark these links: :::info - [x] **Path to this page:** https://bit.ly/scojoe-on-cfmb - [x] **Path to our classroom:** https://us-east-1.student.classrooms.aws.training/class/e19sdFQ5yFKS9XLEZVZZWq ::: --- ## :books: Essential Resources - AWS Cost Optimization Best Practices: https://aws.amazon.com/aws-cost-management/aws-cost-optimization/ - AWS Cloud Economics Center: https://aws.amazon.com/economics/ - Architecture Best Practices for Cost Optimization: https://aws.amazon.com/architecture/cost-optimization/ - Amazon Prescriptive Guidance on Cost: https://aws.amazon.com/prescriptive-guidance/?&apg-all-cards.q=cost - AWS Cost Management Workshops: https://workshops.aws/categories/Cost%20Management --- ## <img src="https://i.imgur.com/oc9UEHM.jpg" alt="drawing" width="50"/> Module 1: Introduction to Cloud Financial Management #### :books: Resources - AWS Well-Architected Framework: https://wa.aws.amazon.com/index.en.html - Cost Optimization Pillar- AWS Well-Architected Framework: https://docs.aws.amazon.com/wellarchitected/latest/framework/cost-optimization.html - AWS Cloud Adoption Framework (AWS CAF): https://aws.amazon.com/cloud-adoption-framework/ - AWS CAF Cloud Financial Management: https://docs.aws.amazon.com/whitepapers/latest/aws-caf-governance-perspective/cloud-financial-management.html - 10 things you can do today to reduce AWS costs: https://aws.amazon.com/blogs/compute/10-things-you-can-do-today-to-reduce-aws-costs/ - Cloud FinOps: Collaborative, Real-Time Cloud Financial Management 1st Edition (O'Reilly): https://www.amazon.com/Cloud-FinOps-Collaborative-Real-Time-Management/dp/1492054623/ #### :video_camera: Videos - AWS re:Invent 2018: Optimizing Costs as You Scale on AWS (ENT302): https://www.youtube.com/watch?v=0XA08hhRVFQ - AWS re:Invent 2019: Managing your cloud financials as you scale on AWS (ENT204-R1): https://www.youtube.com/watch?v=ChupgIbZr5Q #### :keyboard: Hands-on Workshops and Free Digital Training - AWS Well-Architected Labs > Cost Optimization: https://wellarchitectedlabs.com/cost/ - AWS Cloud for Finance Professionals https://explore.skillbuilder.aws/learn/course/external/view/elearning/10803/aws-cloud-for-finance-professionals - AWS Foundations: Cost Management: https://explore.skillbuilder.aws/learn/course/external/view/elearning/1955/aws-foundations-cost-management - AWS Billing and Cost Management: https://explore.skillbuilder.aws/learn/course/external/view/elearning/342/aws-managed-services-ams-logging-and-monitoring --- ## <img src="https://i.imgur.com/Xq80oe3.png" alt="drawing" width="40"/> Module 2: Resource Tagging #### :books: Resources - Use tagging to organize your environment and drive accountability: https://docs.aws.amazon.com/whitepapers/latest/cost-optimization-laying-the-foundation/tagging.html - Tagging strategies: https://aws.amazon.com/answers/account-management/aws-tagging-strategies/ - Tagging best practices: https://d1.awsstatic.com/whitepapers/aws-tagging-best-practices.pdf - Grant permission to tag resources during creation: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/supported-iam-actions-tagging.html - Prescriptive Guidance: Implementing a tagging strategy for detailed cost and usage data: https://docs.aws.amazon.com/prescriptive-guidance/latest/cost-allocation-tagging/introduction.html?did=pg_card&trk=pg_card - AWS Config rules now support proactive compliance:: https://aws.amazon.com/about-aws/whats-new/2022/11/aws-config-rules-support-proactive-compliance/ --- ## <img src="https://i.imgur.com/RYHfifp.png" alt="drawing" width="45"/> Module 3: Pricing and Cost #### :books: Resources - Amazon EC2 Reserved Instances and Other Reservation Models: https://docs.aws.amazon.com/whitepapers/latest/cost-optimization-reservation-models/introduction.html - How AWS Pricing Works: https://d1.awsstatic.com/whitepapers/aws_pricing_overview.pdf - Avoiding unexpected charges: https://docs.aws.amazon.com/awsaccountbilling/latest/aboutv2/checklistforunwantedcharges.html - How Spot Instances Work: https://docs.aws.amazon.com/whitepapers/latest/cost-optimization-leveraging-ec2-spot-instances/how-spot-instances-work.html - Volume discounts: https://docs.aws.amazon.com/awsaccountbilling/latest/aboutv2/useconsolidatedbilling-discounts.html - Tracking your Free Tier usage: https://docs.aws.amazon.com/awsaccountbilling/latest/aboutv2/tracking-free-tier-usage.html - EC2 instance purchasing options: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/instance-purchasing-options.html - Amazon EC2 Reserved Instance Marketplace page: https://aws.amazon.com/ec2/purchasing-options/reserved-instances/marketplace/ --- ## <img src="https://i.imgur.com/5gcz3xm.jpg" alt="drawing" width="50"/> Module 4: AWS Billing, Reporting, and Monitoring #### :books: Resources - Billing user guide: https://docs.aws.amazon.com/IAM/latest/UserGuide/tutorial_billing.html - Automated CUR query and email delivery lab: https://wellarchitectedlabs.com/cost/300_labs/300_automated_cur_query_and_email_delivery - AWS Trusted Advisor best practices checklist: https://aws.amazon.com/premiumsupport/technology/trusted-advisor/best-practice-checklist - Building a Showback Dashboard for Cost Visibility with Serverless Architectures: https://aws.amazon.com/blogs/architecture/building-a-showback-dashboard-for-cost-visibility-with-serverless-architectures/ - Exploring your data using Cost Explorer: https://docs.aws.amazon.com/cost-management/latest/userguide/ce-exploring-data.html - Cost Explorer Advanced Topics: https://docs.aws.amazon.com/cost-management/latest/userguide/ce-advanced.html --- ## <img src="https://i.imgur.com/xIroObB.png" alt="drawing" width="45"/> Module 5: Architecting for Cost: Compute Part 1 #### :books: Resources - Understanding instance naming: <img src="https://i.imgur.com/n1cbuaP.png" alt="drawing" width="580"/> <img src="https://i.imgur.com/CZ31i4V.png" alt="drawing" width="580"/> <img src="https://i.imgur.com/YCUk2dQ.jpg" alt="drawing" width="580"/> <font size=1>(images from: https://www.archerimagine.com/articles/aws/aws-ec2-instance-type-tutorial.html)</font> - It just got easier to discover and compare EC2 instance types: https://aws.amazon.com/blogs/compute/it-just-got-easier-to-discover-and-compare-ec2-instance-types/ - Optimizing your cost with Rightsizing Recommendations: https://docs.aws.amazon.com/awsaccountbilling/latest/aboutv2/ce-rightsizing.html - Right Sizing: Provisioned Instances to Match Workloads: https://docs.aws.amazon.com/whitepapers/latest/cost-optimization-right-sizing/introduction.html - Installing the CloudWatch Agent: https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/install-CloudWatch-Agent-on-EC2-Instance.html - Exporting Log Data to Amazon S3: https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/S3Export.html - Working with Spot Instances: - Spot Instance advisor: https://aws.amazon.com/ec2/spot/instance-advisor/ - Spot Instance interruptions documentation: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/spot-interruptions.html - Hibernate your Linux instance: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/Hibernate.html - Taking Advantage of Amazon EC2 Spot Instance Interruption Notices blog page: https://aws.amazon.com/blogs/compute/taking-advantage-of-amazon-ec2-spot-instance-interruption-notices/ - Spot Integration with Other AWS Services: https://docs.aws.amazon.com/whitepapers/latest/cost-optimization-leveraging-ec2-spot-instances/spot-integration-with-other-aws-services.html - Working with Spot Fleets - How Spot Fleet works: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/spot-fleet.html - Spot Fleet example configurations: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/spot-fleet-examples.html #### :video_camera: Videos - AWS re:Invent 2019: Optimize performance and cost for your AWS compute (CMP323-R1): https://www.youtube.com/watch?v=zt6jYJLK8sg - AWS re:Invent 2018: Amazon EC2 Instances & Performance Optimization Best Practices (CMP307-R1): https://www.youtube.com/watch?v=W0PKclqP3U0 #### :keyboard: Free Digital Training - AWS Managed Services (AMS): Logging and Monitoring: https://explore.skillbuilder.aws/learn/course/external/view/elearning/342/aws-managed-services-ams-logging-and-monitoring --- ## <img src="https://i.imgur.com/ubda82Q.png" alt="drawing" width="55"/> Module 5: Architecting for Cost: Compute Part 2 #### :books: Resources - Maintaining a Fixed Number of Instances in Your Auto Scaling Group: https://docs.aws.amazon.com/autoscaling/ec2/userguide/as-maintain-instance-levels.html - Manual Scaling for Amazon EC2 Auto Scaling: https://docs.aws.amazon.com/autoscaling/ec2/userguide/as-manual-scaling.html - Scheduled Scaling for Amazon EC2 Auto Scaling: https://docs.aws.amazon.com/autoscaling/ec2/userguide/schedule_time.html - Dynamic Scaling for Amazon EC2 Auto Scaling: https://docs.aws.amazon.com/autoscaling/ec2/userguide/as-scale-based-on-demand.html - AWS Instance Scheduler site: https://aws.amazon.com/solutions/implementations/instance-scheduler/ - How do I stop and start Amazon EC2 instances at regular intervals using Lambda? https://aws.amazon.com/premiumsupport/knowledge-center/start-stop-lambda-cloudwatch/ - EC2: Start or Stop Instances Based on Tags: https://docs.aws.amazon.com/IAM/latest/UserGuide/reference_policies_examples_ec2-start-stop-tags.html - Amazon EC2 Auto Scaling Lifecycle Hooks: https://docs.aws.amazon.com/autoscaling/ec2/userguide/lifecycle-hooks.html - AWS Systems Manager Automation site: https://docs.aws.amazon.com/systems-manager/latest/userguide/systems-manager-automation.html - EC2 Fleet – Manage Thousands of On-Demand and Spot Instances with One Request: https://aws.amazon.com/blogs/aws/ec2-fleet-manage-thousands-of-on-demand-and-spot-instances-with-one-request/ - Spot Instance advisor: https://aws.amazon.com/ec2/spot/instance-advisor/ - awslabs ec2-spot-labs github: https://github.com/awslabs/ec2-spot-labs - Allocation strategies for Spot Instances: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ec2-fleet-configuration-strategies.html#ec2-fleet-allocation-strategy - Serverless Applications Lens – AWS Well-Architected Framework: https://docs.aws.amazon.com/whitepapers/latest/wellarchitected-serverless-applications-lens/welcome.html - 10 Things Serverless Architects Should Know: https://aws.amazon.com/blogs/architecture/ten-things-serverless-architects-should-know/ - Best practices for working with AWS Lambda functions: https://docs.aws.amazon.com/lambda/latest/dg/best-practices.html #### :video_camera: Videos - Optimizing Lambda Performance for Your Serverless Applications - AWS Online Tech Talks: https://www.youtube.com/watch?v=FTCaOQJvG6Y - AWS re:Invent 2018: Better, Faster, Cheaper Cost Optimizing Compute with Amazon EC2 Fleet (CMP201): https://www.youtube.com/watch?v=oA04URWQXnM - AWS re:Invent 2018: Better, Faster, Cheaper Cost Optimizing Compute with Amazon EC2 Fleet (CMP201): https://www.youtube.com/watch?v=oA04URWQXnM - AWS re:Invent 2019: Capacity management made easy with Amazon EC2 Auto Scaling (CMP326-R1): https://www.youtube.com/watch?v=9BlsFNBnKHc - Amazon CloudWatch Logs and AWS Lambda: A Match Made in Heaven: https://www.youtube.com/watch?v=MnZPpGhM0WU #### :keyboard: Hands-on Workshop - Scaling cost effective architectures: https://catalog.us-east-1.prod.workshops.aws/workshops/f238037c-8f0b-446e-9c15-ebcc4908901a/en-US --- ## <img src="https://i.imgur.com/y9i3MzG.png" alt="drawing" width="45"/> Module 6: Architecting for Cost: Networking #### :books: Resources - Overview of Data Transfer Costs for Common Architectures: https://aws.amazon.com/blogs/architecture/overview-of-data-transfer-costs-for-common-architectures/ - Exploring Data Transfer Costs for AWS Managed Databases: https://aws.amazon.com/blogs/architecture/exploring-data-transfer-costs-for-aws-managed-databases/ - Amazon Virtual Private Cloud documentation: https://docs.aws.amazon.com/vpc/latest/tgw/TGW_Scenarios.html - AWS Direct Connect documentation: https://docs.aws.amazon.com/directconnect/latest/UserGuide/Welcome.html - Comparison of NAT instances and NAT gateways: https://docs.aws.amazon.com/vpc/latest/userguide/vpc-nat-comparison.html - Prescriptive Guidance - Centralize network connectivity using AWS Transit Gateway: https://docs.aws.amazon.com/prescriptive-guidance/latest/patterns/centralize-network-connectivity-using-aws-transit-gateway.html - VPC endpoints documentation: https://docs.aws.amazon.com/vpc/latest/userguide/vpc-endpoints.html - Video on Demand and Live Streaming Video with CloudFront: https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/on-demand-streaming-video.html - Increasing the Proportion of Requests that Are Served from CloudFront Edge Caches (Cache Hit Ratio): https://docs.aws.amazon.com/AmazonCloudFront/latest/DeveloperGuide/cache-hit-ratio.html - Corey Quinn's Transfer Costs graphic: ![](https://i.imgur.com/mOjNuhl.jpg) #### :video_camera: Videos - AWS re:Invent 2019: Networking best practices for serverless applications (SVS404-R1): https://www.youtube.com/watch?v=PF7HaD567rM #### :keyboard: Free Digital Training - AWS Networking Practical Approaches: https://explore.skillbuilder.aws/learn/course/external/view/elearning/10448/aws-networking-practical-approaches --- ## <img src="https://i.imgur.com/Krd6UO6.png" alt="drawing" width="45"/> Module 7: Architecting for Cost: Storage #### :books: Resources - AWS Storage Portfolio: https://aws.amazon.com/products/storage/?nc2=h_ql_prod_st - User guide for each EBS volume type: - sc1: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ebs-volume-types.html#EBSVolumeTypes_sc1 - st1: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ebs-volume-types.html#EBSVolumeTypes_st1 - gp2: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/ebs-volume-types.html#EBSVolumeTypes_gp2 - gp3: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/general-purpose.html#gp3-ebs-volume-type - io1 and io2: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/provisioned-iops.html#EBSVolumeTypes_piops - Migrate to gp3 from gp2: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/general-purpose.html#migrate-to-gp3 - EBS gp2 to gp3 migration cost savings calculator: https://d1.awsstatic.com/product-marketing/Storage/EBS/gp2_gp3_CostOptimizer.dd5eac2187ef7678f4922fcc3d96982992964ba5.xlsx - Optimizing storage costs using Amazon S3: https://aws.amazon.com/s3/cost-optimization/ - Amazon S3 Intelligent-Tiering: https://aws.amazon.com/s3/storage-classes/intelligent-tiering/ - EFS pricing example breakdown and calculator: https://aws.amazon.com/efs/pricing - EFS storage classes: https://docs.aws.amazon.com/efs/latest/ug/storage-classes.html - EFS throughput modes: https://docs.aws.amazon.com/efs/latest/ug/performance.html#throughput-modes #### :video_camera: Videos: - AWS re:Invent 2019: Best practices for Amazon S3 (including storage classes) (STG302-R): https://www.youtube.com/watch?v=N_3IaOVcIO0 - AWS re:Invent 2019: Guidelines and design patterns for optimizing cost in Amazon S3 (STG240-R2): https://www.youtube.com/watch?v=UPzsRk2lFWE - The Amazon S3 Storage Classes - AWS Online Tech Talks: https://www.youtube.com/watch?v=wFSv2gSQADI - Amazon EBS and Snapshot Optimization Strategies for Better Performance and Cost Savings: https://www.youtube.com/watch?v=h1hzRCsJefs - AWS re:Invent 2019: Best practices for Amazon S3, ft. Thomson Reuters (STG302-R2): https://www.youtube.com/watch?v=mLV0GT2UVcs - AWS re:Invent 2019: Implementing a data lake on Amazon S3 ft. AppsFlyer (STG359-R1): https://www.youtube.com/watch?v=9MzaGFdPfg4 - Query Data in Place With Amazon S3 Select: https://www.youtube.com/watch?v=uxcyoc6uaLM - Simplify Your Data Lifecycle & Optimize Storage Costs With Amazon S3 Lifecycle: https://youtu.be/53eHNSpaMJI #### :keyboard: Free Digital Training: - Deep Dive: Amazon Elastic Block Store (Amazon EBS) Cost Optimization: https://explore.skillbuilder.aws/learn/course/external/view/elearning/10143/deep-dive-amazon-elastic-block-store-amazon-ebs-cost-optimization - Amazon Simple Storage Service (Amazon S3) Cost Optimization: https://explore.skillbuilder.aws/learn/course/external/view/elearning/4983/amazon-simple-storage-service-amazon-s3-cost-optimization --- ## <img src="https://i.imgur.com/VXNla94.png" alt="drawing" width="45"/> Module 8: Architecting for Cost: Databases #### :books: Resources - Amazon RDS: Allows Tag Owners Full Access to RDS Resources That They Have Tagged: https://docs.aws.amazon.com/IAM/latest/UserGuide/reference_policies_examples_rds_tag-owner.html - Caching Strategies: https://docs.aws.amazon.com/AmazonElastiCache/latest/mem-ug/Strategies.html - Compress table data: https://docs.aws.amazon.com/redshift/latest/dg/advisor-recommendations.html#cluster-compression-recommendation - Working with concurrency scaling: https://docs.aws.amazon.com/redshift/latest/dg/concurrency-scaling.html - Overview of managing clusters in Amazon Redshift: https://docs.aws.amazon.com/redshift/latest/mgmt/managing-cluster-operations.html - Querying external data using Amazon Redshift Spectrum: https://docs.aws.amazon.com/redshift/latest/dg/c-using-spectrum.html - Prescriptive Guidance: Estimate the cost of a DynamoDB table for on-demand capacity: https://docs.aws.amazon.com/prescriptive-guidance/latest/patterns/estimate-the-cost-of-a-dynamodb-table-for-on-demand-capacity.html?did=pg_card&trk=pg_card - Prescriptive Guidance: Build a multi-tenant serverless architecture in Amazon OpenSearch: https://docs.aws.amazon.com/prescriptive-guidance/latest/patterns/build-a-multi-tenant-serverless-architecture-in-amazon-opensearch-service.html? --- ## <img src="https://i.imgur.com/mCc2Enf.png" alt="drawing" width="45"/> Module 9: Cost Governance #### :books: Resources - Landing zone guide: https://docs.aws.amazon.com/prescriptive-guidance/latest/migration-aws-environment/understanding-landing-zones.html - Multi-account framework: https://docs.aws.amazon.com/prescriptive-guidance/latest/migration-aws-environment/understanding-landing-zones.html#multi-account-strategy #### :keyboard: Free Digital Training - Automated AWS Landing Zone: https://explore.skillbuilder.aws/learn/course/external/view/elearning/2356/automated-aws-landing-zone - Introduction to AWS Control Tower: https://explore.skillbuilder.aws/learn/course/external/view/elearning/2254/introduction-to-aws-control-tower