Hacker News story: Ask HN: Is anyone doing intelligent tiering for logs?

Ask HN: Is anyone doing intelligent tiering for logs?
You might be familiar with Amazon S3 Intelligent-Tiering: https://ift.tt/DSMCrhx. It automatically moves data to cheaper storage tiers when it hasn’t been accessed for a while. I’m wondering if a similar approach could work for observability data — especially logs. Hot storage is expensive, and much of the data may not be queried after a short period. Moving unused logs to warm or cold storage (or dropping them) could potentially save a lot. Has anyone tried this kind of tiering or aging strategy for logs or metrics? Would love to hear how you approached it — tools, heuristics, lessons learned. Thoughts and speculation are also very welcome! 2 comments on Hacker News.
You might be familiar with Amazon S3 Intelligent-Tiering: https://ift.tt/DSMCrhx. It automatically moves data to cheaper storage tiers when it hasn’t been accessed for a while. I’m wondering if a similar approach could work for observability data — especially logs. Hot storage is expensive, and much of the data may not be queried after a short period. Moving unused logs to warm or cold storage (or dropping them) could potentially save a lot. Has anyone tried this kind of tiering or aging strategy for logs or metrics? Would love to hear how you approached it — tools, heuristics, lessons learned. Thoughts and speculation are also very welcome!

Hacker News story: Ask HN: Is anyone doing intelligent tiering for logs? Hacker News story: Ask HN: Is anyone doing intelligent tiering for logs? Reviewed by Tha Kur on June 12, 2025 Rating: 5

No comments:

Powered by Blogger.