scojoe
    • Create new note
    • Create a note from template
      • Sharing URL Link copied
      • /edit
      • View mode
        • Edit mode
        • View mode
        • Book mode
        • Slide mode
        Edit mode View mode Book mode Slide mode
      • Customize slides
      • Note Permission
      • Read
        • Only me
        • Signed-in users
        • Everyone
        Only me Signed-in users Everyone
      • Write
        • Only me
        • Signed-in users
        • Everyone
        Only me Signed-in users Everyone
      • Engagement control Commenting, Suggest edit, Emoji Reply
    • Invite by email
      Invitee

      This note has no invitees

    • Publish Note

      Share your work with the world Congratulations! 🎉 Your note is out in the world Publish Note No publishing access yet

      Your note will be visible on your profile and discoverable by anyone.
      Your note is now live.
      This note is visible on your profile and discoverable online.
      Everyone on the web can find and read all notes of this public team.

      Your account was recently created. Publishing will be available soon, allowing you to share notes on your public page and in search results.

      Your team account was recently created. Publishing will be available soon, allowing you to share notes on your public page and in search results.

      Explore these features while you wait
      Complete general settings
      Bookmark and like published notes
      Write a few more notes
      Complete general settings
      Write a few more notes
      See published notes
      Unpublish note
      Please check the box to agree to the Community Guidelines.
      View profile
    • Commenting
      Permission
      Disabled Forbidden Owners Signed-in users Everyone
    • Enable
    • Permission
      • Forbidden
      • Owners
      • Signed-in users
      • Everyone
    • Suggest edit
      Permission
      Disabled Forbidden Owners Signed-in users Everyone
    • Enable
    • Permission
      • Forbidden
      • Owners
      • Signed-in users
    • Emoji Reply
    • Enable
    • Versions and GitHub Sync
    • Note settings
    • Note Insights New
    • Engagement control
    • Make a copy
    • Transfer ownership
    • Delete this note
    • Save as template
    • Insert from template
    • Import from
      • Dropbox
      • Google Drive
      • Gist
      • Clipboard
    • Export to
      • Dropbox
      • Google Drive
      • Gist
    • Download
      • Markdown
      • HTML
      • Raw HTML
Menu Note settings Note Insights Versions and GitHub Sync Sharing URL Create Help
Create Create new note Create a note from template
Menu
Options
Engagement control Make a copy Transfer ownership Delete this note
Import from
Dropbox Google Drive Gist Clipboard
Export to
Dropbox Google Drive Gist
Download
Markdown HTML Raw HTML
Back
Sharing URL Link copied
/edit
View mode
  • Edit mode
  • View mode
  • Book mode
  • Slide mode
Edit mode View mode Book mode Slide mode
Customize slides
Note Permission
Read
Only me
  • Only me
  • Signed-in users
  • Everyone
Only me Signed-in users Everyone
Write
Only me
  • Only me
  • Signed-in users
  • Everyone
Only me Signed-in users Everyone
Engagement control Commenting, Suggest edit, Emoji Reply
  • Invite by email
    Invitee

    This note has no invitees

  • Publish Note

    Share your work with the world Congratulations! 🎉 Your note is out in the world Publish Note No publishing access yet

    Your note will be visible on your profile and discoverable by anyone.
    Your note is now live.
    This note is visible on your profile and discoverable online.
    Everyone on the web can find and read all notes of this public team.

    Your account was recently created. Publishing will be available soon, allowing you to share notes on your public page and in search results.

    Your team account was recently created. Publishing will be available soon, allowing you to share notes on your public page and in search results.

    Explore these features while you wait
    Complete general settings
    Bookmark and like published notes
    Write a few more notes
    Complete general settings
    Write a few more notes
    See published notes
    Unpublish note
    Please check the box to agree to the Community Guidelines.
    View profile
    Engagement control
    Commenting
    Permission
    Disabled Forbidden Owners Signed-in users Everyone
    Enable
    Permission
    • Forbidden
    • Owners
    • Signed-in users
    • Everyone
    Suggest edit
    Permission
    Disabled Forbidden Owners Signed-in users Everyone
    Enable
    Permission
    • Forbidden
    • Owners
    • Signed-in users
    Emoji Reply
    Enable
    Import from Dropbox Google Drive Gist Clipboard
       Owned this note    Owned this note      
    Published Linked with GitHub
    1
    • Any changes
      Be notified of any changes
    • Mention me
      Be notified of mention me
    • Unsubscribe
    --- title: Planning and Designing Databases on AWS tags: Resources, Talk description: Resources to support the Planning and Designing Databases on AWS course --- # Planning and Designing Databases on AWS, v2.2.1 ![](https://i.imgur.com/KPL21LH.jpg) Instructor: Scott Jones Email: scojoe@amazon.com ### :pushpin: Bookmark these links: :::warning - [x] **Path to this page:** https://hackmd.io/@scojoe/on-pddbs - [x] **Path to our classroom:** https://us-east-1.student.classrooms.aws.training/class/nNPDofweNz1D6iFmJErYsP - [x] **Polling page:** https://pollev.com/awsboston - [x] **Put through and evaluation (please!)** https://aws.training/Account/Transcript/Archived ::: --- ## :pushpin: AWS Database Essentials :::info - [x] AWS Prescriptive Guidance for Database: https://aws.amazon.com/prescriptive-guidance/?&apg-all-cards.q=Database - [x] Build a Modern Application with Purpose-Built AWS Databases: https://aws.amazon.com/blogs/database/building-a-modern-application-with-purpose-built-aws-databases - [x] AWS Quickstarts for Database: https://aws.amazon.com/quickstart/?awsf.filter-tech-category=tech-category%23databases - [x] AWS Database Workshops: https://workshops.aws/card/database ::: --- ## :fire: What's New ### Blogs/Articles - AWS Database Migration Service now supports enhanced homogeneous migration capabilities: https://aws.amazon.com/about-aws/whats-new/2023/06/aws-database-migration-service-homogeneous-migration/ - Amazon RDS for MySQL supports Optimized Reads on Multi-AZ deployment option with two readable standby database instances: https://aws.amazon.com/about-aws/whats-new/2023/05/amazon-rds-mysql-optimized-reads-multi-az-readable-instances/ - New storage configurations for Amazon Aurora DB clusters: https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/Aurora.Overview.StorageReliability.html#aurora-storage-type - Graph Explorer for Amazon Neptune: https://github.com/aws/graph-explorer - Amazon Neptune Serverless is now generally available: https://aws.amazon.com/about-aws/whats-new/2022/10/amazon-neptune-serverless-generally-available/ - All new AWS database announcements: https://aws.amazon.com/about-aws/whats-new/2023/ --- ## <img src="https://i.imgur.com/JcTRZAl.png" alt="drawing" width="45"/> Module 0: Database Concepts and Choices ### Documents/Articles - Understanding the CAP Theorem: https://dzone.com/articles/understanding-the-cap-theorem - Why the PIE Theorem is More Relevant than the CAP Theorem: https://www.alexdebrie.com/posts/choosing-a-database-with-pie/ - ACID vs. BASE: The Shifting pH of Database Transaction Processing: https://www.dataversity.net/acid-vs-base-the-shifting-ph-of-database-transaction-processing/# - Intuit Mint Case Study: https://aws.amazon.com/solutions/case-studies/intuit-mint/ - From SQL to Microservices: Integrating AWS Lambda with Relational Databases: https://aws.amazon.com/blogs/big-data/from-sql-to-microservices-integrating-aws-lambda-with-relational-databases/ - Gartner Report: 2020 Magic Quadrant for Cloud Database Management Systems: https://pages.awscloud.com/GLOBAL-multi-DL-gartner-mq-cloud-dbms-2020-learn.html - The basics of NoSQL databases — and why we need them: https://medium.com/free-code-camp/nosql-databases-5f6639ed9574 ### Digital Training Courses & Tutorials - Data Analytics Fundamentals: https://www.aws.training/Details/eLearning?id=35364 ## <img src="https://i.imgur.com/DY4OrHQ.png" alt="drawing" width="45"/> Module 1: AWS Purpose-Built Databases ### Documents/Articles - Well-Architected Framework: https://docs.aws.amazon.com/wellarchitected/latest/framework/welcome.html - Data Analytics Lens: https://docs.aws.amazon.com/wellarchitected/latest/analytics-lens/analytics-lens.html - Architecture Best Practices for Database: https://aws.amazon.com/architecture/databases/ - What are NoSQL databases? https://aws.amazon.com/nosql/ - Key-value: https://aws.amazon.com/nosql/key-value/ - Document: https://aws.amazon.com/nosql/document/ - Graph: https://aws.amazon.com/nosql/graph/ - In-memory: https://aws.amazon.com/nosql/in-memory/ - Search Engine: https://aws.amazon.com/nosql/search/ - NoSQL Data Models graphic: ![](https://i.imgur.com/spQ4mcw.jpg) ### Videos - Databases on AWS: The Right Tool for the Right Job (AWS re:Invent 2018): https://www.youtube.com/watch?v=-pb-DkD6cWg&t=535s - Building with Purpose-Built Databases: Match Your Workload to the Right Database (AWS Public Sector Summit 2019): https://www.youtube.com/watch?v=Y2KnmHhyvc0&t=1653s - Matching the Database to the Workload (AWS re:Invent 2018) https://www.youtube.com/watch?v=hwnNbLXN4vA. Discussion about the Iron Triangles begins at 11:30. ### Digital Training Courses & Tutorials - Database Offerings: https://www.aws.training/Details/Curriculum?id=38111 - AWS Purpose Built Databases Workshop: https://amazon-rds-purpose-built.workshop.aws/ --- ## <img src="https://i.imgur.com/tFRFpAY.png" alt="drawing" width="38"/> Module 2: Databases on Amazon RDS ### Documents/Articles - Product page: https://aws.amazon.com/rds/ - User Guide: https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Welcome.html - How Amazon RDS on VMware Works: https://blogs.vmware.com/vsphere/2019/10/how-amazon-rds-on-vmware-works.html - Limitations of Amazon RDS Encrypted DB Instance: https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/Overview.Encryption.html#Overview.Encryption.Limitations - Amazon RDS for PostgreSQL supports cascaded read replicas for up to 30X more read capacity" https://aws.amazon.com/about-aws/whats-new/2022/05/amazon-rds-postgresql-cascaded-read-replicas-30x-capacity/ ### Videos - Introduction to Amazon RDS on VMware: https://www.youtube.com/watch?v=Pd5m19ohFrI - Amazon Relational Database Service: https://www.youtube.com/watch?v=igRfulrrYCo&t - DAT203 - What's New in Amazon RDS: https://www.youtube.com/watch?v=HuvUD7-RyoU ### Digital Training Courses & Tutorials - Amazon RDS Service Primer: https://www.aws.training/Details/eLearning?id=36999 - Amazon RDS Monitoring Workshop for PostgreSQL: https://rdspg-monitoring.workshop.aws/en/ - Amazon RDS for Oracle Immersion Day: https://rdsora.workshop.aws/ - Amazon RDS for SQL Server Workshop: https://rdssms.workshop.aws/ --- ## <img src="https://i.imgur.com/qu8KqVg.png" alt="drawing" width="45"/> Module 3: Databases in Amazon Aurora ### Documents/Articles - Product Page: https://aws.amazon.com/rds/aurora/ - User Guide: https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/CHAP_GettingStartedAurora.html - Amazon Aurora Ascendant: How We Designed a Cloud-Native Relational Database https://www.allthingsdistributed.com/2019/03/Amazon-Aurora-design-cloud-native-relational-database.html. - Aurora vs. RDS: An Engineer’s Guide to Choosing a Database: https://www.lastweekinaws.com/blog/aurora-vs-rds-an-engineers-guide-to-choosing-a-database/ - Is Amazon RDS for PostgreSQL or Amazon Aurora PostgreSQL a better choice for me?: https://aws.amazon.com/blogs/database/is-amazon-rds-for-postgresql-or-amazon-aurora-postgresql-a-better-choice-for-me/ #### Migrating to Aurora - Migrate from Oracle to Amazon Aurora: https://aws.amazon.com/getting-started/hands-on/migrate-oracle-to-amazon-aurora/ - Migrate an Oracle database to Aurora PostgreSQL using AWS DMS and AWS SCT: https://docs.aws.amazon.com/prescriptive-guidance/latest/patterns/migrate-an-oracle-database-to-aurora-postgresql-using-aws-dms-and-aws-sct.html - Oracle to Aurora Migration Playbook: https://d1.awsstatic.com/whitepapers/Migration/oracle-database-amazon-aurora-postgresql-migration-playbook-12.4.pdf - Best Practices for Migrating from Oracle to Amazon Aurora: https://pages.awscloud.com/rs/112-TZM-766/images/EV_best-practices-for-migrating-from-oracle-to-amazon-aurora_Jul-2021.pdf #### Upgrading Amazon Aurora - Amazon Aurora supports Multi Major Version Upgrade to Aurora PostgreSQL 11 and higher: https://aws.amazon.com/about-aws/whats-new/2022/03/amazon-aurora-version-upgrade-aurora-postgresql-11-higher/ - Upgrading the PostgreSQL DB engine for Aurora PostgreSQL: https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/USER_UpgradeDBInstance.PostgreSQL.html - Minimal Downtime major version upgrade for PostgreSQL: https://www.youtube.com/watch?v=S8kX250UIVo ### Videos - Migrating live Pokemon data to Aurora PostgreSQL: https://www.youtube.com/watch?v=2eEKuK5eOC4&list=PLi54SL9oKOa40QnHrdXb1xYQAMa2N6h5k&index=81 - Aurora storage demystified: https://www.youtube.com/watch?v=uaQEGLKtw54&list=PLi54SL9oKOa40QnHrdXb1xYQAMa2N6h5k&index=145 - Aurora Serverless: https://www.youtube.com/watch?v=9mTwxghXvlE&list=PLi54SL9oKOa40QnHrdXb1xYQAMa2N6h5k&index=170 ### Digital Training Courses & Tutorials - Amazon Aurora Service Primer: https://www.aws.training/Details/eLearning?id=36849 - Amazon Aurora Labs for MySQL: https://awsauroralabsmy.com/ --- ## <img src="https://i.imgur.com/2f5KmL2.png" alt="drawing" width="38"/> Module 4: Amazon DynamoDB Tables ### Documents/Articles - Product Page: https://aws.amazon.com/dynamodb/?nc2=h_ql_prod_db_ddb - User Guide: https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/Introduction.html - Improving Data Access with Secondary Indexes: https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/SecondaryIndexes.html - Local Secondary Indexes: https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/LSI.html - Global Secondary Indexes: https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/GSI.html - General Guidelines for Secondary Indexes in DynamoDB: https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/bp-indexes-general.html - How to Design Amazon DynamoDB Global Secondary Indexes: https://aws.amazon.com/blogs/database/how-to-design-amazon-dynamodb-global-secondary-indexes/ - First Steps for Modeling Relational Data in DynamoDB: https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/bp-modeling-nosql.html - NoSQL Design for DynamoDB: https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/bp-general-nosql-design.html - Designing Partition Keys to Distribute Your Workload Evenly: https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/bp-partition-key-uniform-load.html - Using IAM Policy Conditions for Fine-Grained Access Control: https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/specifying-conditions.html - Identity and Access Management in DAX: https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/DAX.access-control.html - Building Modern Apps Using Amazon DynamoDB Transactions: https://collaborate-corp.amazon.com/nuxeo/nxfile/default/20a246c9-5a13-4ae0-aa14-4951383f9559/blobholder:0 - NoSQL Workbench for Amazon DynamoDB https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/workbench.html - DynamoDB Streams Use Cases and Design Patterns https://aws.amazon.com/blogs/database/dynamodb-streams-use-cases-and-design-patterns/ - Simplifying Database Caching with DynamoDB Accelerator (DAX): https://aws.amazon.com/blogs/aws/amazon-dynamodb-accelerator-dax-in-memory-caching-for-read-intensive-workloads/ - Advanced DynamoDB backup: https://docs.aws.amazon.com/aws-backup/latest/devguide/advanced-ddb-backup.html ### Videos - Deep Dive DynamoDB: https://www.youtube.com/watch?v=6yqfmXiZTlM&list=PLi54SL9oKOa40QnHrdXb1xYQAMa2N6h5k&index=40 - Verizon, Push Notification system with DynamoDB: https://www.youtube.com/watch?v=FwWT6a3ikZ4&list=PLi54SL9oKOa40QnHrdXb1xYQAMa2N6h5k&index=76 - Moving from Cassandra to DynamoDB: https://www.youtube.com/watch?v=DInYm0YWS4w&list=PLi54SL9oKOa40QnHrdXb1xYQAMa2N6h5k&index=99 - Uber implements Ledgers in DynamoDB: https://www.youtube.com/watch?v=iN6mhI5hFt4&list=PLi54SL9oKOa40QnHrdXb1xYQAMa2N6h5k&index=105 - Adaptive Capacity: https://www.youtube.com/watch?v=zUsJK5pe_A0&list=PLi54SL9oKOa40QnHrdXb1xYQAMa2N6h5k&index=146 - Data Modeling with DynamoDB: https://www.youtube.com/watch?v=DIQVJqiSUkE&list=PLi54SL9oKOa40QnHrdXb1xYQAMa2N6h5k&index=164 - Good episode on Estimating the Cost of Using DynamoDB: https://www.twitch.tv/aws/video/498613939 ### Digital Training Courses & Tutorials - Amazon DynamoDB Service Primer: https://www.aws.training/Details/eLearning?id=36858 --- ## <img src="https://i.imgur.com/qsCjWkU.png" alt="drawing" width="45"/> Module 5: Amazon Keyspaces Databases ### Documents/Articles - What is the problem with key-value databases and how wide column stores solve it: https://indexoutofrange.com/What-is-the-problem-with-key-value-databases-and-how-wide-column-databases-solve-it/ - PwC Blogpost: https://aws.amazon.com/blogs/database/idea-to-product-pwc-launches-check-in-within-three-months-on-amazon-keyspaces/ - Sample code: https://github.com/aws-samples/amazon-keyspaces-examples - Amazon Keyspaces FAQs: https://aws.amazon.com/keyspaces/faqs/ - Amazon Keyspaces Developer Guide: https://docs.aws.amazon.com/keyspaces/latest/devguide/what-is-keyspaces.html - Define and optimize data partitions in Apache Cassandra: https://opensource.com/article/20/5/apache-cassandra - Apache Cassandra (Wikipedia): https://en.wikipedia.org/wiki/Apache_Cassandra# - Wide column data models: ![](https://i.imgur.com/6IjlaKD.png) - Wide column data storage: ![](https://i.imgur.com/7BoWRfn.jpg) ### Videos - Overview of Amazon Keyspaces (for Apache Cassandra): https://youtu.be/PYdLIvBHe2E - Running Apache Cassandra Workloads by Using Amazon Keyspaces - AWS Online Tech Talks: https://youtu.be/zehVQzlSuEU ### Digital Training Courses & Tutorials - Amazon Keyspaces Workshop (for Apache Cassandra): https://amazon-keyspaces-immersionday.workshop.aws/en/ - Tutorial: Create a keyspace and a table in Amazon Keyspaces: https://docs.aws.amazon.com/keyspaces/latest/devguide/getting-started.ddl.html --- ## <img src="https://i.imgur.com/Ytxs5n7.png" alt="drawing" width="45"/> Module 6: Databases in Amazon DocumentDB ### Documents/Articles - Product Page: https://aws.amazon.com/documentdb/ - User Guide: https://docs.aws.amazon.com/documentdb/latest/developerguide/what-is.html - Managing Amazon DocumentDB Endpoints: https://docs.aws.amazon.com/documentdb/latest/developerguide/endpoints.html - Connecting to Endpoints: https://docs.aws.amazon.com/documentdb/latest/developerguide/endpoints-connecting.html - Read Preference Options: https://docs.aws.amazon.com/documentdb/latest/developerguide/how-it-works.html#durability-consistency-isolation - Connecting to Amazon DocumentDB as a Replica Set: https://docs.aws.amazon.com/documentdb/latest/developerguide/connect-to-replica-set.html - Backing Up and Restoring in Amazon DocumentDB: https://docs.aws.amazon.com/documentdb/latest/developerguide/backup-restore.html - Getting started with Amazon DocumentDB: https://aws.amazon.com/documentdb/getting-started/ - MongoDB replica sets, reference this link: https://docs.mongodb.com/manual/tutorial/deploy-replica-set/ - How Zulily drives discovery shopping using Amazon Kinesis Data Analytics and Amazon DocumentDB: https://aws.amazon.com/blogs/database/how-zulily-drives-discovery-shopping-using-amazon-kinesis-data-analytics-and-amazon-documentdb/ ### Videos - Migrating your databases to DocumentDB: https://www.youtube.com/watch?v=qmb7ssDH6Pg&list=PLi54SL9oKOa40QnHrdXb1xYQAMa2N6h5k&index=28 - Deep Dive on DocumentDB: https://www.youtube.com/watch?v=D3_hWN9C9iE&list=PLi54SL9oKOa40QnHrdXb1xYQAMa2N6h5k&index=160 ### Digital Training Courses & Tutorials - Amazon DocumentDB Service Primer: https://www.aws.training/Details/eLearning?id=36852 - Amazon DocumentDB (with MongoDB compatibility) workshop: https://documentdb-immersionday.workshop.aws/ - AWS Online Tech Talks: Amazon DocumentDB Case Studies and Best Practices --- ## <img src="https://i.imgur.com/2dOxQs8.png" alt="drawing" width="45"/> Module 7: Databases in Amazon QLDB ### Documents/Articles - Product Page: https://aws.amazon.com/qldb/ - User Guide: https://docs.aws.amazon.com/qldb/latest/developerguide/what-is.html - Inserting Documents: https://docs.aws.amazon.com/qldb/latest/developerguide/working.create.html#working.create.insert - Amazon Ion Github: http://amzn.github.io/ion-docs/ - Amazon QLDB PartiQL reference guide: https://docs.aws.amazon.com/qldb/latest/developerguide/ql-reference.html - Updating and Deleting Documents: https://docs.aws.amazon.com/qldb/latest/developerguide/working.revisions.html - History Function: https://docs.aws.amazon.com/qldb/latest/developerguide/working.history.html#working.history.function - Querying Revision History: https://docs.aws.amazon.com/qldb/latest/developerguide/working.history.html - Using Amazon QLDB with Interface VPC Endpoints: https://docs.aws.amazon.com/qldb/latest/developerguide/vpc-endpoints.html - Journal Export Output in QLDB: https://docs.aws.amazon.com/qldb/latest/developerguide/export-journal.output.html ### Videos - Adding Managed BlockChain and QLDB to your portfolio: https://www.youtube.com/watch?v=bmNBD_q38XU&list=PLi54SL9oKOa40QnHrdXb1xYQAMa2N6h5k&index=102 - Deep Dive QLDB: https://www.youtube.com/watch?v=ZfYDl4kaVCo&list=PLi54SL9oKOa40QnHrdXb1xYQAMa2N6h5k&index=107 - PartiQL language: https://www.youtube.com/watch?v=ZsEOhCOFOe4&list=PLi54SL9oKOa40QnHrdXb1xYQAMa2N6h5k&index=157 - BMW Customer story (start at 11:25): https://www.youtube.com/watch?v=TMQuN0eqPck ### Digital Training Courses & Tutorials - Amazon QLDB Service Primer: https://www.aws.training/Details/eLearning?id=41760 - Amazon QLDB Immersion Day Workshops: https://qldb-immersionday.workshop.aws/en/ --- ## <img src="https://i.imgur.com/up0SDhd.png" alt="drawing" width="45"/> Module 8: Databases in Amazon Neptune ### Documents/Articles - Product Page: https://aws.amazon.com/neptune/?nc2=h_ql_prod_db_nep - User Guide: https://docs.aws.amazon.com/neptune/latest/userguide/intro.html - Accessing the Neptune Graph with Gremlin: https://docs.aws.amazon.com/neptune/latest/userguide/access-graph-gremlin.html - Accessing the Neptune Graph with SPARQL: https://docs.aws.amazon.com/neptune/latest/userguide/access-graph-sparql.html - Apache TinkerPop: The Gremlin Graph Traversal Machine and Language: https://tinkerpop.apache.org/gremlin.html - SPARQL Query Language for RDF: https://www.w3.org/TR/rdf-sparql-query/ - High availability for Neptune: https://docs.aws.amazon.com/neptune/latest/userguide/feature-overview-availability.html - Loading data into Neptune using Gremlin: https://docs.datastax.com/en/dse/5.1/dse-dev/datastax_enterprise/graph/using/insertDataGremlin.html ### Videos - - Getting Started with Neptune Serverless: https://www.youtube.com/watch?v=pVJJcsjkRyc - Amazon Neptune Service Primer: https://www.aws.training/Details/eLearning?id=36902 ### Digital Training Courses & Tutorials - AWS Online Tech Talks: Getting Started with Amazon Neptune: https://pages.awscloud.com/AWS-Learning-Path-Getting-Started-with-Amazon-Neptune_2020_LP_0009-DAT.html - Getting Started with Amazon Neptune: https://explore.skillbuilder.aws/learn/course/internal/view/elearning/14165/getting-started-with-amazon-neptune - Building a Knowledge Graph on Amazon Neptune using Comprehend Events: https://catalog.workshops.aws/build-a-knowledge-graph/en-US --- ## <img src="https://i.imgur.com/QMJOBVs.png" alt="drawing" width="40"/> Module 9: Databases in Amazon Timestream ### Documents/Articles - Timestream use cases: https://docs.aws.amazon.com/timestream/latest/developerguide/what-is-timestream.html#what-is.use-cases. - Timestream functions: For additional information, see https://docs.aws.amazon.com/timestream/latest/developerguide/timeseries-specific-constructs.functions.html - Timestream concepts: https://docs.aws.amazon.com/timestream/latest/developerguide/concepts.html - AWS Timestream Data generator tool for DevOps: https://github.com/awslabs/amazon-timestream-tools/tree/mainline/tools/continuous-ingestor#continuous-data-generator-for-writing-devops-metrics-into-amazon-timestream - AWS Timestream - Writes: https://docs.aws.amazon.com/timestream/latest/developerguide/writes.html - AWS Timestream - Queries: https://docs.aws.amazon.com/timestream/latest/developerguide/sample-queries.html - AWS Timestream - Timeseries views: https://docs.aws.amazon.com/timestream/latest/developerguide/timeseries-specific-constructs.views.html#timeseries-specific-constructs.views.CREATE_TIME_SERIES - AWS Timestream - Date/Time functions Eg: bin(): https://docs.aws.amazon.com/timestream/latest/developerguide/date-time-functions.html - How to metric - P50, P90, and P99 explained: https://medium.com/@djsmith42/how-to-metric-edafaf959fc7 ### Videos - Deep Dive on Amazon Timestream - AWS Online Tech Talks: https://youtu.be/39ijv_pfWSQ - Querying Time Series with Amazon Timestream and JDBC Driver: https://youtu.be/9qyZ1PN5yJc - Analyzing Data in Amazon Timestream using Amazon QuickSight: https://youtu.be/TzW4HWl-L8s - Visualizing AWS Timestream data using Grafana: https://youtu.be/pilkz645cs4 ### Digital Training Courses & Tutorials - Amazon Timestream Tutorial: https://docs.aws.amazon.com/timestream/latest/developerguide/getting-started.db-w-sample-data.html --- ## <img src="https://i.imgur.com/2ZDdxXP.png" alt="drawing" width="50"/> Module 10: Databases in Amazon ElastiCache ### Documents/Articles - Product Page: https://aws.amazon.com/elasticache/ - Redis User Guide: https://docs.aws.amazon.com/AmazonElastiCache/latest/red-ug/WhatIs.html - Memcached User Guide: https://docs.aws.amazon.com/AmazonElastiCache/latest/mem-ug/WhatIs.html - Amazon ElastiCache: Comparing Redis and Memcached https://aws.amazon.com/elasticache/redis-vs-memcached/ - AWS Service Limits: Amazon ElastiCache https://docs.aws.amazon.com/general/latest/gr/aws_service_limits.html#limits_elasticache - Amazon ElastiCache for Redis User Guide: Caching Strategies: https://docs.aws.amazon.com/AmazonElastiCache/latest/red-ug/Strategies.html - Amazon ElastiCache for Memcached User Guide: Caching Strategies: https://docs.aws.amazon.com/AmazonElastiCache/latest/mem-ug/Strategies.html - Amazon ElastiCache for Memcached User Guide: Choosing Your Node Size: https://docs.aws.amazon.com/AmazonElastiCache/latest/mem-ug/nodes-select-size.html - Amazon ElastiCache for Memcached User Guide: Configuring Your ElastiCache Client for Efficient Load Balancing: https://docs.aws.amazon.com/AmazonElastiCache/latest/mem-ug/BestPractices.LoadBalancing.html - Scaling ElastiCache for Memcached Clusters page https://docs.aws.amazon.com/AmazonElastiCache/latest/mem-ug/Scaling.html - Amazon ElastiCache for Redis User Guide: Working with Shards: https://docs.aws.amazon.com/AmazonElastiCache/latest/red-ug/Shards.html - Redis Sharding: Sharding (Partitioning) Schemes https://www.javacodegeeks.com/2015/09/redis-sharding.html#sharding_(partitioning)_schemes ### Videos - What’s new with ElastiCache, 2019: https://www.youtube.com/watch?v=SaGW_Bln3qA&list=PLi54SL9oKOa40QnHrdXb1xYQAMa2N6h5k&index=20 - Supercharge Real-time apps with ElastiCache: https://www.youtube.com/watch?v=v0GfpL5jfns&list=PLi54SL9oKOa40QnHrdXb1xYQAMa2N6h5k&index=79 ### Digital Training Courses & Tutorials - ElastiCache Tutorials and Videos: https://docs.aws.amazon.com/AmazonElastiCache/latest/red-ug/Tutorials.html - Boosting MySQL database performance: https://aws.amazon.com/getting-started/hands-on/boosting-mysql-database-performance-with-amazon-elasticache-for-redis/ - Building a Fast Session Store for your Online Applications: https://aws.amazon.com/getting-started/hands-on/building-fast-session-caching-with-amazon-elasticache-for-redis/ - Amazon ElastiCache ServicePrimer: https://www.aws.training/Details/eLearning?id=36893 --- ## <img src="https://i.imgur.com/CcriByG.png" alt="drawing" width="45"/> Module 11: Databases in Amazon MemoryDB for Redis ### Documents/Articles - What is MemoryDB?: https://docs.aws.amazon.com/memorydb/latest/devguide/what-is-memorydb-for-redis.html - Get Started with Amazon MemoryDB for Redis: https://aws.amazon.com/memorydb/getting-started/ - AWS Redis information: https://aws.amazon.com/redis/ ### Videos - Getting Started with Amazon MemoryDB for Redis - AWS Online Tech Talks: https://youtu.be/Jbq_XZMZEKY ### Digital Training Courses & Tutorials - Getting Started with Amazon MemoryDB for Redis: https://explore.skillbuilder.aws/learn/course/internal/view/elearning/10067/getting-started-with-amazon-memorydb-for-redis --- ## <img src="https://i.imgur.com/pq0ueMK.png" alt="drawing" width="45"/> Module 12: Data Warehouses in Amazon Redshift ### Documents/Articles - Product Page: https://aws.amazon.com/redshift/?nc2=h_ql_prod_db_rs - Management Guide: https://docs.aws.amazon.com/redshift/latest/mgmt/welcome.html - Developer Guide: https://docs.aws.amazon.com/redshift/latest/dg/welcome.html - Data Warehouse System Architecture: https://docs.aws.amazon.com/redshift/latest/dg/c_high_level_system_architecture.html - Clusters and Nodes in Amazon Redshift: https://docs.aws.amazon.com/redshift/latest/mgmt/working-with-clusters.html#rs-about-clusters-and-nodes - Twelve Best Practices for Amazon Redshift Spectrum: https://aws.amazon.com/blogs/big-data/10-best-practices-for-amazon-redshift-spectrum/ - Using Redshift Spectrum with AWS Lake Formation: https://docs.aws.amazon.com/redshift/latest/dg/spectrum-lake-formation.html - RA3 Nodes: https://aws.amazon.com/redshift/features/ra3/ - Designing Tables: https://docs.aws.amazon.com/redshift/latest/dg/t_Creating_tables.html - Columnar Storage: https://docs.aws.amazon.com/redshift/latest/dg/c_columnar_storage_disk_mem_mgmnt.html - Choosing a Column Compression Type: https://docs.aws.amazon.com/redshift/latest/dg/t_Compressing_data_on_disk.html - AWS Service Endpoints: Amazon Redshift: https://docs.aws.amazon.com/general/latest/gr/redshift-service.html - Amazon Redshift Serverless: https://aws.amazon.com/redshift/redshift-serverless/ - Amazon Redshift Drive - Performance Tuning: https://aws.amazon.com/blogs/big-data/top-10-performance-tuning-techniques-for-amazon-redshift/ - How MEDHOST’s cardiac risk prediction successfully leveraged AWS analytic services: https://aws.amazon.com/blogs/big-data/how-medhosts-cardiac-risk-prediction-successfully-leveraged-aws-analytic-services/ ### Videos - What’s new with Redshift, 2019, featuring Yelp: https://www.youtube.com/watch?v=sCEhmBnQ7M0&list=PLi54SL9oKOa40QnHrdXb1xYQAMa2N6h5k&index=19 - What’s new with Redshift, 2019, featuring Workday: https://www.youtube.com/watch?v=lN6tfUX4CcE&list=PLi54SL9oKOa40QnHrdXb1xYQAMa2N6h5k&index=119 - Deep Dive Best Practices of Redshift: https://www.youtube.com/watch?v=lj8oaSpCFTc&list=PLi54SL9oKOa40QnHrdXb1xYQAMa2N6h5k&index=106 - How to scale Analytics with Redshift: https://www.youtube.com/watch?v=V9r_sP2-zzs&list=PLi54SL9oKOa40QnHrdXb1xYQAMa2N6h5k&index=110 - Build a data analytics stack with Redshift: https://www.youtube.com/watch?v=svj3srbhfUw&list=PLi54SL9oKOa40QnHrdXb1xYQAMa2N6h5k&index=172 ### Digital Training Courses & Tutorials - Amazon Redshift Service Primer: https://www.aws.training/Details/eLearning?id=36901 - Redshift Analytics Workshop: https://redshift-analytics.workshop.aws/ - Redshift Immersion Labs: https://redshift-immersion.workshop.aws/ - Redshift Deep Dive: https://redshift-deepdive.workshop.aws/ ## <img src="https://i.imgur.com/RBaIkK4.png" alt="drawing" width="45"/> Module 13: Tools for Working with AWS Databases ### Documents/Articles - Amazon Athena FAQs: https://aws.amazon.com/athena/faqs/?nc=sn&loc=6 - AWS Database Migration Service: https://aws.amazon.com/dms/ - AWS Schema Conversion Tool: https://aws.amazon.com/dms/schema-conversion-tool/?nc=sn&loc=2 ### Digital Training Courses & Tutorials - Amazon Athena Workshop: https://catalog.us-east-1.prod.workshops.aws/workshops/9981f1a1-abdc-49b5-8387-cb01d238bb78/en-US - Migration Workshops: https://workshops.aws/card/migration - Data Analytics Fundamentals: https://explore.skillbuilder.aws/learn/course/44/data-analytics-fundamentals - Introduction to Amazon Athena: https://explore.skillbuilder.aws/learn/course/152/introduction-to-amazon-athena --- ## :book: Prepare for the Database Specialty Certification - AWS Certified Database - Specialty: https://aws.amazon.com/certification/certified-database-specialty/ - Exam Guide: https://d1.awsstatic.com/training-and-certification/docs-database-specialty/AWS-Certified-Database-Specialty_Exam-Guide.pdf - Sample questions: https://d1.awsstatic.com/training-and-certification/docs-database-specialty/AWS-Certified-Database-Specialty_Sample-Questions.pdf - Exam prep: https://aws.amazon.com/certification/certification-prep/#Exam_preparation_with_AWS_Skill_Builder - Related webinars: https://aws.amazon.com/training/events/?get-certified-vilt-courses-cards - Practice exams: https://explore.skillbuilder.aws/learn/course/internal/view/elearning/9405/aws-certified-database-specialty-official-practice-question-set-dbs-c01-english?dtbs=sec&sec=prep - 10 study tips for the AWS Certified Database – Specialty Certification: https://aws.amazon.com/blogs/training-and-certification/10-study-tips-for-the-aws-certified-database-specialty-certification/

    Import from clipboard

    Paste your markdown or webpage here...

    Advanced permission required

    Your current role can only read. Ask the system administrator to acquire write and comment permission.

    This team is disabled

    Sorry, this team is disabled. You can't edit this note.

    This note is locked

    Sorry, only owner can edit this note.

    Reach the limit

    Sorry, you've reached the max length this note can be.
    Please reduce the content or divide it to more notes, thank you!

    Import from Gist

    Import from Snippet

    or

    Export to Snippet

    Are you sure?

    Do you really want to delete this note?
    All users will lose their connection.

    Create a note from template

    Create a note from template

    Oops...
    This template has been removed or transferred.
    Upgrade
    All
    • All
    • Team
    No template.

    Create a template

    Upgrade

    Delete template

    Do you really want to delete this template?
    Turn this template into a regular note and keep its content, versions, and comments.

    This page need refresh

    You have an incompatible client version.
    Refresh to update.
    New version available!
    See releases notes here
    Refresh to enjoy new features.
    Your user state has changed.
    Refresh to load new user state.

    Sign in

    Forgot password
    or
    Sign in via Facebook Sign in via X(Twitter) Sign in via GitHub Sign in via Dropbox Sign in with Wallet
    Wallet ( )
    Connect another wallet

    New to HackMD? Sign up

    By signing in, you agree to our terms of service.

    Help

    • English
    • 中文
    • Français
    • Deutsch
    • 日本語
    • Español
    • Català
    • Ελληνικά
    • Português
    • italiano
    • Türkçe
    • Русский
    • Nederlands
    • hrvatski jezik
    • język polski
    • Українська
    • हिन्दी
    • svenska
    • Esperanto
    • dansk

    Documents

    Help & Tutorial

    How to use Book mode

    Slide Example

    API Docs

    Edit in VSCode

    Install browser extension

    Contacts

    Feedback

    Discord

    Send us email

    Resources

    Releases

    Pricing

    Blog

    Policy

    Terms

    Privacy

    Cheatsheet

    Syntax Example Reference
    # Header Header 基本排版
    - Unordered List
    • Unordered List
    1. Ordered List
    1. Ordered List
    - [ ] Todo List
    • Todo List
    > Blockquote
    Blockquote
    **Bold font** Bold font
    *Italics font* Italics font
    ~~Strikethrough~~ Strikethrough
    19^th^ 19th
    H~2~O H2O
    ++Inserted text++ Inserted text
    ==Marked text== Marked text
    [link text](https:// "title") Link
    ![image alt](https:// "title") Image
    `Code` Code 在筆記中貼入程式碼
    ```javascript
    var i = 0;
    ```
    var i = 0;
    :smile: :smile: Emoji list
    {%youtube youtube_id %} Externals
    $L^aT_eX$ LaTeX
    :::info
    This is a alert area.
    :::

    This is a alert area.

    Versions and GitHub Sync
    Get Full History Access

    • Edit version name
    • Delete

    revision author avatar     named on  

    More Less

    Note content is identical to the latest version.
    Compare
      Choose a version
      No search result
      Version not found
    Sign in to link this note to GitHub
    Learn more
    This note is not linked with GitHub
     

    Feedback

    Submission failed, please try again

    Thanks for your support.

    On a scale of 0-10, how likely is it that you would recommend HackMD to your friends, family or business associates?

    Please give us some advice and help us improve HackMD.

     

    Thanks for your feedback

    Remove version name

    Do you want to remove this version name and description?

    Transfer ownership

    Transfer to
      Warning: is a public team. If you transfer note to this team, everyone on the web can find and read this note.

        Link with GitHub

        Please authorize HackMD on GitHub
        • Please sign in to GitHub and install the HackMD app on your GitHub repo.
        • HackMD links with GitHub through a GitHub App. You can choose which repo to install our App.
        Learn more  Sign in to GitHub

        Push the note to GitHub Push to GitHub Pull a file from GitHub

          Authorize again
         

        Choose which file to push to

        Select repo
        Refresh Authorize more repos
        Select branch
        Select file
        Select branch
        Choose version(s) to push
        • Save a new version and push
        • Choose from existing versions
        Include title and tags
        Available push count

        Pull from GitHub

         
        File from GitHub
        File from HackMD

        GitHub Link Settings

        File linked

        Linked by
        File path
        Last synced branch
        Available push count

        Danger Zone

        Unlink
        You will no longer receive notification when GitHub file changes after unlink.

        Syncing

        Push failed

        Push successfully