Ask HN: Is anyone doing intelligent tiering for logs?
You might be familiar with Amazon S3 Intelligent-Tiering: https://ift.tt/DSMCrhx. It automatically moves data to cheaper storage tiers when it hasn’t been accessed for a while. I’m wondering if a similar approach could work for observability data — especially logs. Hot storage is expensive, and much of the data may not be queried after a short period. Moving unused logs to warm or cold storage (or dropping them) could potentially save a lot. Has anyone tried this kind of tiering or aging strategy for logs or metrics? Would love to hear how you approached it — tools, heuristics, lessons learned. Thoughts and speculation are also very welcome! 2 comments on Hacker News.
You might be familiar with Amazon S3 Intelligent-Tiering: https://ift.tt/DSMCrhx. It automatically moves data to cheaper storage tiers when it hasn’t been accessed for a while. I’m wondering if a similar approach could work for observability data — especially logs. Hot storage is expensive, and much of the data may not be queried after a short period. Moving unused logs to warm or cold storage (or dropping them) could potentially save a lot. Has anyone tried this kind of tiering or aging strategy for logs or metrics? Would love to hear how you approached it — tools, heuristics, lessons learned. Thoughts and speculation are also very welcome!
You might be familiar with Amazon S3 Intelligent-Tiering: https://ift.tt/DSMCrhx. It automatically moves data to cheaper storage tiers when it hasn’t been accessed for a while. I’m wondering if a similar approach could work for observability data — especially logs. Hot storage is expensive, and much of the data may not be queried after a short period. Moving unused logs to warm or cold storage (or dropping them) could potentially save a lot. Has anyone tried this kind of tiering or aging strategy for logs or metrics? Would love to hear how you approached it — tools, heuristics, lessons learned. Thoughts and speculation are also very welcome! 2 comments on Hacker News.
You might be familiar with Amazon S3 Intelligent-Tiering: https://ift.tt/DSMCrhx. It automatically moves data to cheaper storage tiers when it hasn’t been accessed for a while. I’m wondering if a similar approach could work for observability data — especially logs. Hot storage is expensive, and much of the data may not be queried after a short period. Moving unused logs to warm or cold storage (or dropping them) could potentially save a lot. Has anyone tried this kind of tiering or aging strategy for logs or metrics? Would love to hear how you approached it — tools, heuristics, lessons learned. Thoughts and speculation are also very welcome!
Hacker News story: Ask HN: Is anyone doing intelligent tiering for logs?
Reviewed by Tha Kur
on
June 12, 2025
Rating:
No comments: