10 000 RPS и доступность 99,99%: как устроено шардирование PG в процессинге Яндекс Такси

Когда система растёт, нагрузка на базу становится критичной, а готовых решений для шардирования PostgreSQL не хватает. Стандартные подходы не подошли — поэтому команда сделала свое решение для шардирования в ядре процессинга заказов. Оно позволяет решардировать данные без простоев и деградации метрик. Привет, Хабр! Меня зовут Игорь Березняк, я руковожу группой процессинга в Техплатформе Городских сервисов Яндекса. В этой статье по мотивам моего доклада на

https://habr.com/ru/companies/yandex/articles/985030/

#postgresql #шардирование #sharding #userver #Распределенные_системы #Миграции_данных

#CaseStudy - Discover how #Uber evolved their distributed storage platform from static rate limiting to a priority-aware load management system to safeguard their in-house databases.

This shift tackled the limits of QPS-based rate limiting in large, multi-tenant systems - handling noisy neighbors, and protecting tail latency.

Read more on #InfoQ 👉 https://bit.ly/4rjf8IW

#DistributedData #LowLatency #Sharding #LoadBalancing

#ITByte: #Sharding is a #Database #Architecture #Pattern that involves splitting a large dataset into smaller chunks.

Sharding can help distribute traffic load by splitting data into separate rows and columns on separate database server instances.

https://knowledgezone.co.in/posts/Sharding-Architecture-Pattern-659903618562c2adedb9de22

Sharding is not new, but #sharding data around #DRAM in clusters is certainly going to be a topic in #2026! Happy new year! Hug every little 4gb stick you may have!

Previsão de Preços Zilliqa (ZIL) 2030#AnáliseCripto #Blockchain #Criptomoedas #investimento #Sharding #Zilliqa Enquanto o mundo das criptomoedas permanece hypnotizado por narrativas de “próximo Bitcoin”, uma revolução silenciosa está reescrevendo as regras da escalabilidade blockchain. Será que Zilliqa (ZIL) representa a chave perdida para desbloquear o verdadeiro potencial das aplicações descentralizadas em massa, e c...
https://cryptoativo.com/previsao-de-precos-zilliqa-zil-2030/?fsp_sid=28656

Khám phá Phần 3 xây dựng hạ tầng SaaS: Citus Database Performance – khi sharding giúp và khi gây hại. Bài viết phân tích khi nào phân vùng dữ liệu thực sự tăng hiệu suất, khi nào lại khiến truy vấn chậm và tăng chi phí. Các lưu ý: phù hợp với read‑heavy workloads, tránh sharding khi write‑bound hoặc dữ liệu liền kề. Bạn muốn tối ưu Citus? Đọc ngay nhé!
#SaaS #Citus #Sharding #CơSởDữLiệu #DatabaseOptimization

https://www.reddit.com/r/SaaS/comments/1p6rpq3/part_3_saas_infrastructure_buildout_ci

#CaseStudy - #Airbnb upgraded Mussel!

The multi-tenant key-value store now replaces static per-client rate limits with an adaptive, resource-aware traffic control system.
✅ Ensures resilience during traffic spikes
✅ Protects critical workflows
✅ Maintains fair usage across thousands of tenants
✅ Scales efficiently

Discover more here: https://bit.ly/48yJalh

#InfoQ #SoftwareArchitecture #LowLatency #Kubernetes #CostSavings #RealTime #Algorithms #Sharding

#Sharding is (another) one of the things that makes @couchdb such a scalable distributed database 📐

It’s an architectural consideration that very few DBs make as automatic and transparent as CouchDB.

We cover, in depth:
- what shards are
- how #CouchDB uses them
- performance gains and trade-offs

in our new post:
https://neighbourhood.ie/blog/2025/10/01/first-steps-sharding-in-couchdb?pk_campaign=mastodon&pk_kwd=shard

A sharded DuckDB on 63 nodes runs 1T row aggregation challenge in 5 sec

https://gizmodata.com/blog/gizmoedge-one-trillion-row-challenge

#HackerNews #DuckDB #Sharding #Aggregation #Challenge #1T #Rows #BigData #Performance

Meet 𝐌𝐨𝐧𝐨𝐜𝐥𝐞 – Datadog’s new 𝐫𝐞𝐚𝐥-𝐭𝐢𝐦𝐞 𝐭𝐢𝐦𝐞𝐬𝐞𝐫𝐢𝐞𝐬 𝐬𝐭𝐨𝐫𝐚𝐠𝐞 𝐞𝐧𝐠𝐢𝐧𝐞!

Written in #RustLang, it unifies metrics storage infrastructure to deliver:
⇨ Higher ingestion throughput
⇨ Lower query latency
⇨ Reduced operational complexity

🔗 Details here: https://bit.ly/3VTWLNb

#InfoQ #SoftwareArchitecture #Observability #DataStorage #Sharding

Previsão de Preços Zilliqa (ZIL) 2030#AnáliseCripto #Blockchain #Criptomoedas #investimento #Sharding #Zilliqa Enquanto o mundo das criptomoedas permanece hypnotizado por narrativas de “próximo Bitcoin”, uma revolução silenciosa está reescrevendo as regras da escalabilidade blockchain. Será que Zilliqa (ZIL) representa a chave perdida para desbloquear o verdadeiro potencial das aplicações descentralizadas em massa, e como isso pode transformar r...
https://forexinvesti.com/?p=227231&fsp_sid=5413

NEAR Protocol (NEAR)

#Tradingan - #Grafik #harga #NEAR Protocol (NEAR) hari ini untuk membantu #analisa #pasar sebelum memulai #investasi dan #trading #kripto NEAR Protocol #NEAR. NEAR Protocol adalah #blockchain generasi ketiga yang dirancang untuk mengatasi masalah skalabilitas, kecepatan, dan biaya transaksi tinggi yang dihadapi oleh jaringan seperti Ethereum. NEAR menggunakan #teknologi #sharding dan mekanisme #konsensus Proof-of-Stake (PoS) untuk menciptakan…

https://tradingan.com/near-protocol

😂 Ah, another magical tool promising to effortlessly transform your crusty old #Postgres into a horizontally scaling unicorn without any of those annoying extensions! #PgDog, because why bother understanding your #database when you can just slap on some "automatic sharding" and call it a day? 🚀🐶
https://github.com/pgdogdev/pgdog #automatic #sharding #humor #HackerNews #ngated

Шардированный не значит распределённый: что важно знать, когда PostgreSQL становится мало

Шардирование, двухфазный коммит и распределенные транзакции окружены определенными мифами и заблуждениями. Например, может быть достаточно неочевидно, что двухфазный коммит обеспечивает только атомарность транзакций, но не их изоляцию. Поэтому мы решили написать пост, который бы помог разобраться в этих сложных вещах и сделать правильный выбор, когда Postgres'а Вам станет мало и Вы столкнётесь с шардированием.

https://habr.com/ru/companies/ydb/articles/907024/

#субд #postgres #postgresql #citus #sharding #distributed #ydb #dbms #consistency #acid

Sharding là gì? Cơ chế hoạt động và tiềm năng của Sharding
Blogtrading sẽ cung cấp đến các trader thông tin, đặc điểm, cách thức hoạt động , các công nghệ vận hành Sharding... chi tiết tại:
https://blogtrading.net/sharding-la-gi/
Hastag: #blogtrading #Blogtradingnet #sangiaodich #sangiaodichforex #Sharding

Sharding Pgvector

https://pgdog.dev/blog/sharding-pgvector

#HackerNews #Sharding #Pgvector #Sharding #Database #PostgreSQL #Tech #Blog #Data #Management

Verleihen Sie Ihrer Anwendung mit MongoDB Sharding mehr Leistung und Skalierbarkeit!

Wir entwickeln individuelle Lösungen für Ihre Bedürfnisse. 💡🚀

https://www.elinext.de/blog/mongodb-sharding-mit-cpp/

#MongoDB #sharding #softwareentwicklung #tech #programming

Linked is a modern explanation of sharding and other approaches to dealing with scaling db backends. https://salas.com/2025/01/26/database-sharding-explained/#database #sharding #explainer #software-engineering

#ITByte: #Sharding is a #Database #Architecture #Pattern that involves splitting a large dataset into smaller chunks.

Sharding can help distribute traffic load by splitting data into separate rows and columns on separate database server instances.

https://knowledgezone.co.in/posts/Sharding-Architecture-Pattern-659903618562c2adedb9de22

How to improve database performance from DesignGurus.io? Forgot who is the author … discovered it on the @LinkedIn a couple of days ago … Because the original *GIF* file but shows the static image on the #WeChat moment I have to share it via a small *MP4* file on the #WeChat channel …

#RDBMS #Database #PerformanceTuning #Indexing #MaterializedViews #VerticalScaling #Denormalization #Caching #Replication #Sharding #Partitioning #QueryOptimization