msk-managed-kafka¶
not in china part¶
- serverless version not available in china region
- 26Q1
msk connect - depend on pca 2023 Q3
推荐参数¶
| 参数 | Standard (3-AZ) | Standard (2-AZ) | Express (仅 3-AZ) | |
|---|---|---|---|---|
| 1 | min.insync.replicas | 2 (默认) | 1 (默认) | 2 (强制) |
| 2 | default.replication.factor | 3 (默认) | 2 (默认) | 3 (强制) |
| 3 | unclean.leader.election.enable | 建议 false (默认true) ⚠️ | true (默认true) ⚠️ | false (强制) |
| 4 | acks | all(3.x 默认) | all(3.x 默认) | all(3.x 默认) |
| 5 | enable.idempotence | true(3.x 默认) | true(3.x 默认) | true(3.x 默认) |
最佳实践¶
standard broker
https://docs.aws.amazon.com/msk/latest/developerguide/bestpractices.html
容灾¶
- 直接使用 MSK Replicator MSK 复制器
推荐博客
官方文档
| 文档 | 内容 |
|---|---|
| Use replication to increase resiliency (https://docs.aws.amazon.com/msk/latest/developerguide/msk-replicator-increase-resiliency.html) | Active-Active / Active-Passive 架构说明 |
| Perform planned failover (https://docs.aws.amazon.com/msk/latest/developerguide/msk-replicator-perform-planned-failover.html) | 计划内切换步骤 |
| Perform unplanned failover (https://docs.aws.amazon.com/msk/latest/developerguide/msk-replicator-perform-unplanned-failover.html) | 非计划切换(灾难恢复)步骤 |
| Perform failback (https://docs.aws.amazon.com/msk/latest/developerguide/msk-replicator-perform-failback.html) | 故障恢复后回切步骤 |
community¶
client download¶
https://kafka.apache.org/quickstart
refer¶
性能测试相关博客推荐
-
Split your monolithic Apache Kafka clusters using Amazon MSK Serverless
-
mysql-msk-redshift
官方文档
- Best practices for Standard brokers (https://docs.aws.amazon.com/msk/latest/developerguide/bestpractices.html) - 官方最佳实践指南
-
Amazon MSK Express brokers (https://docs.aws.amazon.com/msk/latest/developerguide/msk-broker-types-express.html) - Express broker 详细文档