# Planning and Designing Databases on AWS

Welcome to the Planning and Designing Databases on AWS class. This will be used as supporting material above and beyond Redshift that you can take with you.

### RDS

Title | Link
--- | ---
Performance Insights |https://aws.amazon.com/de/blogs/database/set-alarms-on-performance-insights-metrics-using-amazon-cloudwatch/

### Aurora
Title | Link
--- | ---
Aurora Deep Dive 2019 | https://www.youtube.com/watch?v=GwEtiRZR4g4
Aurora Global Database | https://www.youtube.com/watch?v=1vFg1z-2E7Y&t=6s
Aurora storage demystified | https://www.youtube.com/watch?v=DrtwAOND1Pc
Aurora What's New 2021 | https://www.youtube.com/watch?v=N8M3BZuuUlo
Aurora Serverless v2 | https://www.youtube.com/watch?v=PQHZrtIgdiA
Aurora Serverless v1 vs v2 | https://www.jeremydaly.com/aurora-serverless-v2-preview/
Aurora Multi Master | https://www.youtube.com/watch?v=p0C0jakzYuc

### DMS
Title | Link
--- | ---
Migrating from Oracle to Aurora|https://aws.amazon.com/de/blogs/database/a-quick-introduction-to-migrating-from-an-oracle-database-to-an-amazon-aurora-postgresql-database/
Change Data Capture (CDC)|https://aws.amazon.com/de/blogs/database/aws-dms-now-supports-native-cdc-support/
Migrating to S3|https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Target.S3.html

### DynamoDB

Title | Link
--- | ---
DynamoDB API|https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/HowItWorks.API.html
Design Patterns|https://www.youtube.com/watch?v=HaEPXoXVf2k
Original Paper|https://www.allthingsdistributed.com/files/amazon-dynamo-sosp2007.pdf

### AWS Neptune

Title | Link
--- | ---
Neptune Business Impact|https://www.youtube.com/watch?v=AKnaGqHZY9c
Deep Dive|https://www.youtube.com/watch?v=dSqNAlYAAoQ
Use Cases|https://www.youtube.com/watch?v=6dHiJSMdbjc
Neptune Workbench | https://aws.amazon.com/de/blogs/database/visualize-query-results-using-the-amazon-neptune-workbench/
Federated Query|https://aws.amazon.com/about-aws/whats-new/2019/10/amazon-neptune-now-supports-SPARQL-11-federated-query/
ElasticSearch Integration|https://docs.aws.amazon.com/neptune/latest/userguide/full-text-search.html
Air Routes Blog Post|https://aws.amazon.com/de/blogs/database/let-me-graph-that-for-you-part-1-air-routes/
SPARQL Documentation|https://www.w3.org/TR/sparql11-query/

### CAP Theorem
Title | Link
--- | ---
CAP Critique | https://martin.kleppmann.com/2015/05/11/please-stop-calling-databases-cp-or-ap.html

### Kinesis

Title | Link
--- | ---
Kinesis Best Practices | https://www.youtube.com/watch?v=jKPlGznbfZ0
Enhanced Fanout | https://aws.amazon.com/blogs/aws/kds-enhanced-fanout/
Streaming ETL|https://aws.amazon.com/de/blogs/big-data/unified-serverless-streaming-etl-architecture-with-amazon-kinesis-data-analytics/
Storm Integration|https://github.com/amazon-archives/kinesis-storm-spout
Flink and Kinesis|https://aws.amazon.com/blogs/big-data/streaming-etl-with-apache-flink-and-amazon-kinesis-data-analytics/

### Lambda

Title | Link
--- | --- | ---
Lambda Destinations|https://aws.amazon.com/blogs/compute/introducing-aws-lambda-destinations/
2|https://www.refinery.io/post/how-to-chain-serverless-functions-call-invoke-a-lambda-from-another-lambda
3|https://www.youtube.com/watch?v=Jkx6kVbDpL4
4|https://www.thoughtworks.com/insights/blog/mitigating-serverless-lock-fears

### Step Functions

Title | Link
--- | ---
1|https://aws.amazon.com/de/blogs/aws/new-using-step-functions-to-orchestrate-amazon-emr-workloads/
2|https://aws.amazon.com/about-aws/whats-new/2020/09/aws-step-functions-adds-support-for-aws-x-ray/

### MSK Managed Kafka

Title | Link
--- | ---
1|https://www.youtube.com/watch?v=HtU9pb18g5Q

### Lake Formation

Title | Link
--- | ---
Lake Formation Demo|https://www.youtube.com/watch?v=Aj5T5fcZZr0

### EMR

Title | Link
--- | ---
Deep Dive and Best Practices|https://www.youtube.com/watch?v=dU40df0Suoo
Whats new 2020|https://pages.awscloud.com/Deep-Dive-into-Whats-New-in-Amazon-EMR_2020_0230-ABD_OD.html
EMR 6.0.0|https://www.youtube.com/watch?v=M_EOXbJhD3g
2|https://aws.amazon.com/de/blogs/big-data/build-a-self-service-environment-for-each-line-of-business-using-amazon-emr-and-aws-service-catalog/
3|https://aws.amazon.com/de/blogs/big-data/apply-record-level-changes-from-relational-databases-to-amazon-s3-data-lake-using-apache-hudi-on-amazon-emr-and-aws-database-migration-service/
Flink|https://aws.amazon.com/de/blogs/big-data/use-apache-flink-on-amazon-emr/
File Formats|https://www.youtube.com/watch?v=aIcxFIyL6xo
Spark Optimization|https://www.youtube.com/watch?v=daXEp4HmS-E
Spark on EMR|https://www.youtube.com/watch?v=aIwJlfEAlHQ
EMR vs Glue|https://aws.amazon.com/de/blogs/big-data/how-drop-used-the-amazon-emr-runtime-for-apache-spark-to-halve-costs-and-get-results-5-4-times-faster/

### Hive

Title | Link
--- | ---
ACID Transactions|https://aws.amazon.com/de/blogs/big-data/amazon-emr-supports-apache-hive-acid-transactions/

### Resiliency

Title | Link
--- | ---
1|https://aws.amazon.com/de/blogs/big-data/optimizing-amazon-emr-for-resilience-and-cost-with-capacity-optimized-spot-instances/
2|https://www.youtube.com/watch?v=Fup5vHEvU50
3|https://github.com/bbc/chaos-lambda

### Glue

Title | Link
--- | ---
Data Brew|https://aws.amazon.com/glue/features/databrew/
Data Lakes with Glue|https://www.youtube.com/watch?v=JsNR8uBVSiA
1|https://www.youtube.com/watch?v=S_xeHvP7uMo
2|https://aws.amazon.com/de/blogs/big-data/aws-serverless-data-analytics-pipeline-reference-architecture/
3|https://aws.amazon.com/de/blogs/big-data/crafting-serverless-streaming-etl-jobs-with-aws-glue/

### Athena

Title | Link
--- | ---
1|https://www.youtube.com/watch?v=tzoXRRCVmIQ
2|https://www.youtube.com/watch?v=JIviltfpul0

### Spark

Title | Link
--- | ---
Spark Jobs on EKS|https://www.youtube.com/watch?v=Om8RRGbZ6zA
Spark on EKS Best Practices | https://www.youtube.com/watch?v=3EbTr79wLkU

### BigData Architecture

Title | Link
--- | ---
Spark on EKS |https://www.youtube.com/watch?v=lHM96P5kP2k
Use case 1|https://www.youtube.com/watch?v=XpFNznmRoQ0
Use case 2|https://www.youtube.com/watch?v=wbh51O3QrE4
Data Lake|https://www.youtube.com/watch?v=7i1tj59pvYw
Hearst Corp|https://www.youtube.com/watch?v=6cwbbqi36k8

### Nitro System

Title | Link
--- | ---
AWS Hypervisor Security|https://www.youtube.com/watch?v=0qcUOKupt7Y

### Re:Invent 2020

Title | Link
--- | ---
Re:Invent | https://reinvent.awsevents.com