Лучшие практики при использовании RDS PostgreSQL с cross-region репликами:
https://aws.amazon.com/blogs/database/best-practices-for-amazon-rds-for-postgresql-cross-region-read-replicas/
#RDS #PostgreSQL #best_practices
https://aws.amazon.com/blogs/database/best-practices-for-amazon-rds-for-postgresql-cross-region-read-replicas/
#RDS #PostgreSQL #best_practices
Weekly Summary on AWS (
🔸 Chime SDK + background replacement
🔸 Cloud Map API + IPv6
🔸 DocumentDB
➖ 1-month free trial (
➖ $geoIntersects
➖ $geoWithin
➖ $mergeObjects
➖ $reduce
🔸 EC2 X2iezn instances (32:1 ratio of memory to vCPU)
🔸 ECS Anywhere + ECS Exec and Amazon Linux 2
🔸 EFS Replication
🔸 Fraud Detector + prediction explanations
🔸 FSx for ONTAP + increase storage capacity
🔸 GuardDuty + EKS
🔸 Lightsail CDN + Lightsail Container Services
as origin
🔸 MWAA (Airflow) + version 2.2
🔸 PrivateLink + CloudWatch metrics
🔸 QuickSight + comparative and cumulative date/time calculations
🔸 RDS for PostgreSQL 14.1, 13.5, 12.9, 11.14, 10.19, and 9.6.24
🔸 RDS Performance Insights + query execution plan
🔸 S3 File Gateway + schedule-based network bandwidth throttling
🔸 SageMaker Autopilot
➖ 100 GB datasets (before - 10GB)
➖ Apache Parquet file format
🔸 Textract + single page PDF documents & JPEG 2000 encoded images
🔹 Panorama Appliances + available for purchase
#AWS_week
January 23-29)🔸 Chime SDK + background replacement
🔸 Cloud Map API + IPv6
🔸 DocumentDB
➖ 1-month free trial (
t3.medium, 750 hours / 30M IOs / 5GB)➖ $geoIntersects
➖ $geoWithin
➖ $mergeObjects
➖ $reduce
🔸 EC2 X2iezn instances (32:1 ratio of memory to vCPU)
🔸 ECS Anywhere + ECS Exec and Amazon Linux 2
🔸 EFS Replication
🔸 Fraud Detector + prediction explanations
🔸 FSx for ONTAP + increase storage capacity
🔸 GuardDuty + EKS
🔸 Lightsail CDN + Lightsail Container Services
as origin
🔸 MWAA (Airflow) + version 2.2
🔸 PrivateLink + CloudWatch metrics
🔸 QuickSight + comparative and cumulative date/time calculations
🔸 RDS for PostgreSQL 14.1, 13.5, 12.9, 11.14, 10.19, and 9.6.24
🔸 RDS Performance Insights + query execution plan
🔸 S3 File Gateway + schedule-based network bandwidth throttling
🔸 SageMaker Autopilot
➖ 100 GB datasets (before - 10GB)
➖ Apache Parquet file format
🔸 Textract + single page PDF documents & JPEG 2000 encoded images
🔹 Panorama Appliances + available for purchase
#AWS_week
👍4🔥3
Weekly Summary on AWS (
🔸 Amplify iOS Library + Swift
🔸 Aurora PostgreSQL + Multi Major Version Upgrade
🔸 Braket + OpenQASM 3.0
🔸 Chime SDK + live transcription with automatic language identification
🔸 Comprehend + Targeted Sentiment
🔸 DevOps Guru + CodeGuru Profiler for Lambda
🔸 DynamoDB
➖ Limit request option for PartiQL
➖ Tables Per Account 256 → 2,500
➖ Еnable management operations 50 → 500
🔸 EC2 AMI + LastLaunchedTime
🔸 EC2 + X2idn/X2iedn instances 💥
🔸 ECS Update Service API + loadBalancers, propagateTags, enableECSManagedTags, and serviceRegistries 👀
🔸 Glue DataBrew + cross-account Glue Data Catalog S3 access
🔸 Lambda + PrincipalOrgID 💪
🔸 Lightsail + S3 block public access 🎉
🔸 MSK Connect + Secrets Manager
🔸 Personalize + CloudFormation
🔸 QuickSight + auto refresh
🔸 SSM Change Manager + approve/reject multiple change requests together
🔹 Bottlerocket + NVIDIA GPUs 👍
🔹 Genomics CLI + Snakemake
🔹 RDS for MySQL + 5.7.37 and 8.0.28
🔹 RDS for Oracle + Oracle Database 21c
🔹 RDS for PostgreSQL + 14.2, 👈 13.6, 12.10, 11.15, and 10.20
🔹 RDS for SQL Server + M6i/R6i instances
#AWS_week
March 6 - 12)🔸 Amplify iOS Library + Swift
🔸 Aurora PostgreSQL + Multi Major Version Upgrade
🔸 Braket + OpenQASM 3.0
🔸 Chime SDK + live transcription with automatic language identification
🔸 Comprehend + Targeted Sentiment
🔸 DevOps Guru + CodeGuru Profiler for Lambda
🔸 DynamoDB
➖ Limit request option for PartiQL
➖ Tables Per Account 256 → 2,500
➖ Еnable management operations 50 → 500
🔸 EC2 AMI + LastLaunchedTime
🔸 EC2 + X2idn/X2iedn instances 💥
🔸 ECS Update Service API + loadBalancers, propagateTags, enableECSManagedTags, and serviceRegistries 👀
🔸 Glue DataBrew + cross-account Glue Data Catalog S3 access
🔸 Lambda + PrincipalOrgID 💪
🔸 Lightsail + S3 block public access 🎉
🔸 MSK Connect + Secrets Manager
🔸 Personalize + CloudFormation
🔸 QuickSight + auto refresh
🔸 SSM Change Manager + approve/reject multiple change requests together
🔹 Bottlerocket + NVIDIA GPUs 👍
🔹 Genomics CLI + Snakemake
🔹 RDS for MySQL + 5.7.37 and 8.0.28
🔹 RDS for Oracle + Oracle Database 21c
🔹 RDS for PostgreSQL + 14.2, 👈 13.6, 12.10, 11.15, and 10.20
🔹 RDS for SQL Server + M6i/R6i instances
#AWS_week
👍2👎1
Weekly Summary on AWS (
🔸 AppConfig Feature Flags + GA
🔸 App Mesh Envoy Management Service (EMS) + CloudTrail
🔸 Backup Audit Manager + '
🔸 Billing Conductor
🔸 Chatbot + GA for management of AWS resources from Slack
🔸 Chime SDK
➖ Amazon Lex voice bots
➖ Amazon Voice Focus
🔸 Cognito + in-region SES/SNS integration
🔸 Connect + rich formatting in chat messages
🔸 Cost Anomaly Detection + AWS Chatbot
🔸 ECS Anywhere + Windows
🔸 EKS
🔸 Kendra FSx Connector for Windows File Server
🔸 KMS & ACM + latest hybrid post-quantum TLS ciphers
🔸 Lambda console + sharing test events
🔸 Location Service + HERE Explore & HERE Explore Truck map stypes
🔸 Lookout for Vision + GA & Starter Kit
🔸 RDS for PostgreSQL + mysql_fdw
🔸 Route 53 Private DNS + Geolocation and Latency-Based Routing
🔸 Route 53 Resolver DNS Firewall + reducing the cost
🔸 PrivateLink + RoboMaker
🔸 Service Catalog + VPC Endpoint Policies
#AWS_week
March 13-19)🔸 AppConfig Feature Flags + GA
🔸 App Mesh Envoy Management Service (EMS) + CloudTrail
🔸 Backup Audit Manager + '
cross-Region copy', 'cross-account copy', and 'backups protected by AWS Backup Vault Lock' controls🔸 Billing Conductor
🔸 Chatbot + GA for management of AWS resources from Slack
🔸 Chime SDK
➖ Amazon Lex voice bots
➖ Amazon Voice Focus
🔸 Cognito + in-region SES/SNS integration
🔸 Connect + rich formatting in chat messages
🔸 Cost Anomaly Detection + AWS Chatbot
🔸 ECS Anywhere + Windows
🔸 EKS
1.21 + containerd on Windows nodes🔸 Kendra FSx Connector for Windows File Server
🔸 KMS & ACM + latest hybrid post-quantum TLS ciphers
🔸 Lambda console + sharing test events
🔸 Location Service + HERE Explore & HERE Explore Truck map stypes
🔸 Lookout for Vision + GA & Starter Kit
🔸 RDS for PostgreSQL + mysql_fdw
🔸 Route 53 Private DNS + Geolocation and Latency-Based Routing
🔸 Route 53 Resolver DNS Firewall + reducing the cost
🔸 PrivateLink + RoboMaker
🔸 Service Catalog + VPC Endpoint Policies
#AWS_week
👍1
Weekly Summary on AWS (
🔸 ACM Private CA + custom subject names, extensions, and name constraints
🔸 Amplify + @mapsTo to rename models while retaining data
🔸 Billing + detailed break down of costs for RDS 👀
🔸 Chime SDK + 10 000 live participants
🔸 Comprehend + extract custom entities from images and Textract JSON files
🔸 Connect forecasting, capacity planning, and scheduling
🔸 Cost Anomaly Detection + resource and tag based access management
🔸 Cost Categories + resource and tag based access controls
🔸 EC2 Metadata + autoscaling/target-lifecycle-state
🔸 ECS + warm pools for EC2 Auto Scaling
🔸 GameKit for Unreal Game Engine 🎉
🔸 GameSparks 💥
🔸 Kendra + Slack Connector
🔸 Lambda +
🔸 Lex + grammar slot type
🔸 Panorama
➖ CloudWatch alarms
➖ Receiving inbound messages over the local area network
➖ TensorFlow, PyTorch, and OpenCV
🔸 Proton + Terraform GA
🔸 QuickSight + Groups Management UI
🔸 RDS for PostgreSQL + tds_fdw to connect to a SQL Server
🔸 RDS Service APIs + IPv6 👈
🔸 Service Management Connector for JSM (Jira) + AWS Support
🔸 Transcribe Call Analytics + call summarization
🔹 Corretto 18
🔹 Free Tier +
#AWS_week
March 20-26)🔸 ACM Private CA + custom subject names, extensions, and name constraints
🔸 Amplify + @mapsTo to rename models while retaining data
🔸 Billing + detailed break down of costs for RDS 👀
🔸 Chime SDK + 10 000 live participants
🔸 Comprehend + extract custom entities from images and Textract JSON files
🔸 Connect forecasting, capacity planning, and scheduling
🔸 Cost Anomaly Detection + resource and tag based access management
🔸 Cost Categories + resource and tag based access controls
🔸 EC2 Metadata + autoscaling/target-lifecycle-state
🔸 ECS + warm pools for EC2 Auto Scaling
🔸 GameKit for Unreal Game Engine 🎉
🔸 GameSparks 💥
🔸 Kendra + Slack Connector
🔸 Lambda +
/tmp ephemeral storage: 512 MB → 10 GB 👍🔸 Lex + grammar slot type
🔸 Panorama
➖ CloudWatch alarms
➖ Receiving inbound messages over the local area network
➖ TensorFlow, PyTorch, and OpenCV
🔸 Proton + Terraform GA
🔸 QuickSight + Groups Management UI
🔸 RDS for PostgreSQL + tds_fdw to connect to a SQL Server
🔸 RDS Service APIs + IPv6 👈
🔸 Service Management Connector for JSM (Jira) + AWS Support
🔸 Transcribe Call Analytics + call summarization
🔹 Corretto 18
🔹 Free Tier +
db.t3.micro/db.t4g.micro for RDS 💪#AWS_week
👍2
Тихая Open Source революция AWS
Меньше 24 часов назад от времени написания этого поста вышла первая публичная бета PostgreSQL 16:
https://www.postgresql.org/about/news/postgresql-16-beta-1-released-2643/
В то же время RDS PostgreSQL16 уже доступна на AWS и даже есть документация:
https://docs.aws.amazon.com/AmazonRDS/latest/PostgreSQLReleaseNotes/postgresql-versions.html#postgresql-versions-version16
Так быстро внедрить новую фичу, да ещё и написать документацию?! Документация точно занимает минимум несколько дней — как же так?
Всё просто. Единственное объяснение, если вы эту фичу и разрабатываете. Приглядитесь-полистайте, сколько представителей Amazon Web Services среди главных контрибьютеров PostgreSQL:
https://www.postgresql.org/community/contributors/
Теперь, думаю, понятно.
AWS много лет (и справедливо) ругали за то, что они используют Open Source продукты лишь получая прибыль и ничего не отдавая взамен.
Несколько лет стратегия AWS по отношению к Open Source стала совсем другой. Появились крупные Open Source проекты: OpenSearch, bottlerocket, Firecracker, FreeRTOS, Babelfish for PostgreSQL, EKS Distro. Также стоит отметить серьёзный вклад в разработку Fluentd (в тройке) и даже Kubernetes (в десятке). Однозначно есть куда расти, но ещё пяток лет назад такого вообще не было.
В общем, ситуация изменилась и продолжает меняться. И это однозначно радует. 👍
#OpenSource
Меньше 24 часов назад от времени написания этого поста вышла первая публичная бета PostgreSQL 16:
https://www.postgresql.org/about/news/postgresql-16-beta-1-released-2643/
В то же время RDS PostgreSQL16 уже доступна на AWS и даже есть документация:
https://docs.aws.amazon.com/AmazonRDS/latest/PostgreSQLReleaseNotes/postgresql-versions.html#postgresql-versions-version16
Так быстро внедрить новую фичу, да ещё и написать документацию?! Документация точно занимает минимум несколько дней — как же так?
Всё просто. Единственное объяснение, если вы эту фичу и разрабатываете. Приглядитесь-полистайте, сколько представителей Amazon Web Services среди главных контрибьютеров PostgreSQL:
https://www.postgresql.org/community/contributors/
Теперь, думаю, понятно.
AWS много лет (и справедливо) ругали за то, что они используют Open Source продукты лишь получая прибыль и ничего не отдавая взамен.
Несколько лет стратегия AWS по отношению к Open Source стала совсем другой. Появились крупные Open Source проекты: OpenSearch, bottlerocket, Firecracker, FreeRTOS, Babelfish for PostgreSQL, EKS Distro. Также стоит отметить серьёзный вклад в разработку Fluentd (в тройке) и даже Kubernetes (в десятке). Однозначно есть куда расти, но ещё пяток лет назад такого вообще не было.
В общем, ситуация изменилась и продолжает меняться. И это однозначно радует. 👍
#OpenSource
PostgreSQL News
PostgreSQL 16 Beta 1 Released!
The PostgreSQL Global Development Group announces that the first beta release of PostgreSQL 16 is now [available for download](https://www.postgresql.org/download/). This …
👍47🔥9❤4👎1
A great example of how to migrate from MongoDB to PostgreSQL.
https://blog.stuartspence.ca/2023-05-goodbye-mongo.html
Five years ago, MongoDB was all the rage. Riding the NoSQL fad, rather than real-world requirements, many startups chose MongoDB as their primary database. If you have such a project, a migration to a "regular" SQL database is a very good idea.
PostgreSQL is now the most popular, and rightly so. This article will give you the arguments for migration to a more convenient for most cases PostgreSQL.
#PostgreSQL #MongoDB
https://blog.stuartspence.ca/2023-05-goodbye-mongo.html
Five years ago, MongoDB was all the rage. Riding the NoSQL fad, rather than real-world requirements, many startups chose MongoDB as their primary database. If you have such a project, a migration to a "regular" SQL database is a very good idea.
PostgreSQL is now the most popular, and rightly so. This article will give you the arguments for migration to a more convenient for most cases PostgreSQL.
#PostgreSQL #MongoDB
❤4
Active-active Replication for RDS PostgreSQL
https://aws.amazon.com/blogs/database/using-pgactive-active-active-replication-extension-for-postgresql-on-amazon-rds-for-postgresql/
▫️ Active-active Replication can be used to maintain availability throughout different database operations and reduce write latency for applications distributed in multiple AWS Regions.
▫️ PostgreSQL
#RDS #PostgreSQL
https://aws.amazon.com/blogs/database/using-pgactive-active-active-replication-extension-for-postgresql-on-amazon-rds-for-postgresql/
▫️ Active-active Replication can be used to maintain availability throughout different database operations and reduce write latency for applications distributed in multiple AWS Regions.
▫️ PostgreSQL
pgactive extension makes it possible to deploy RDS PostgreSQL instances using an active-active topology, and provides the foundational features for managing active-active replication such as conflict detection and resolution. #RDS #PostgreSQL
Amazon
Using pgactive: Active-active Replication Extension for PostgreSQL on Amazon RDS for PostgreSQL | Amazon Web Services
In this post, we walk through an example for creating an active-active replication setup between two RDS for PostgreSQL instances. We also show how to monitor replication lag between instances, and review how to detect and resolve conflicts. Finally, we discuss…
🔥7👍2
Just Use Postgres for Everything:
▪️ Redis -> Postgres with UNLOGGED tables and TEXT as a JSON
▪️ Kafka -> Postgres with SKIP LOCKED
▪️ MongoDB -> Postgres with JSONB
▪️ ElasticSeacrh -> Postgres
▪️ Data warehouse -> Postgres with Timescale
▪️ Analytics -> Postgres with pg_analytics
▪️ CRON -> Postgres with pg_cron
▪️ Geospacial -> Postgres with PostGIS
▪️ Audit -> Postgres with pgaudit
▪️ GraphQL -> Postgres with a GraphQL adapter
https://www.amazingcto.com/postgres-for-everything/
#PostgreSQL
▪️ Redis -> Postgres with UNLOGGED tables and TEXT as a JSON
▪️ Kafka -> Postgres with SKIP LOCKED
▪️ MongoDB -> Postgres with JSONB
▪️ ElasticSeacrh -> Postgres
▪️ Data warehouse -> Postgres with Timescale
▪️ Analytics -> Postgres with pg_analytics
▪️ CRON -> Postgres with pg_cron
▪️ Geospacial -> Postgres with PostGIS
▪️ Audit -> Postgres with pgaudit
▪️ GraphQL -> Postgres with a GraphQL adapter
https://www.amazingcto.com/postgres-for-everything/
#PostgreSQL
🔥17😁15🤡11❤4👎3👀3🤮2💩2
Релиз PostgreSQL 17 на AWS:
https://aws.amazon.com/about-aws/whats-new/2024/09/postgresql-170-amazon-rds-database-preview-environment/
Спустя 6 часов после официального анонса:
https://www.postgresql.org/about/news/postgresql-17-released-2936/
Что нового в 17-й версии:
▫️ up to 20x less memory for Vacuum
▫️ up to 2x better write I/O for highload
▫️ JSON Support 👇
▪️
▪️ New functions
▫️
▫️
#PostgreSQL
https://aws.amazon.com/about-aws/whats-new/2024/09/postgresql-170-amazon-rds-database-preview-environment/
Спустя 6 часов после официального анонса:
https://www.postgresql.org/about/news/postgresql-17-released-2936/
Что нового в 17-й версии:
▫️ up to 20x less memory for Vacuum
▫️ up to 2x better write I/O for highload
▫️ JSON Support 👇
▪️
JSON_TABLE - сonvert JSON data into standard PostgreSQL tables▪️ New functions
JSON, JSON_SCALAR, JSON_SERIALIZE, JSON_EXISTS, JSON_QUERY, JSON_VALUE▫️
sslnegotiation option for direct TLS handshakes using ALPN▫️
pg_basebackup now supports incremental backups#PostgreSQL
Amazon
PostgreSQL 17.0 is now available in Amazon RDS Database preview environment - AWS
Discover more about what's new at AWS with PostgreSQL 17.0 is now available in Amazon RDS Database preview environment
👍21🔥3
🆕 Aurora PostgreSQL + Local write forwarding
https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/aurora-postgresql-write-forwarding.html
With write forwarding, your applications can simply send both read and write requests to a read replica, and Aurora will take care of forwarding the write requests to the writer instance in your cluster.
#Aurora #PostgreSQL
https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/aurora-postgresql-write-forwarding.html
With write forwarding, your applications can simply send both read and write requests to a read replica, and Aurora will take care of forwarding the write requests to the writer instance in your cluster.
#Aurora #PostgreSQL
🔥19👍7👎2