Show HN: Logtail – ClickHouse-Based Log Management

  • The pain of not being able to do complex queries in an Elastic world means this is a pretty logical conclusion. I'd love to see the ability to also collect metrics and traces in Clickhouse as well, which would let me easily join across dynamic service boundaries to collate information I need.

    For example, being able to correlate a customer ID (stored in a log) to a trace ID (stored in the request trace) to Snowflake warehouse usage (stored as metrics) to a subset of the pipeline (mixed between logs and traces) to get a full understanding of how much each customer cost us in terms of Snowflake usage would be immensely valuable.

  • Looks v.good, using Clickhouse as the persistence is interesting, pricing certainly is very competative when comapred to the likes of logentries et al.

  • We tried Logtail in early beta and the experience was mind bending.

    We used both ELK and Datadog before and over time I somehow stopped questioning why the logs are so slow. I thought we are simply hitting the theoretical limits of how fast searching in logs can be and unless there is a significant leap in hardware this is what we have to deal with. Then we tried Logtail and now we are migrating everything we can.

  • I like the idea integrated Grafana support! Perhaps finally a way for us to reduce the amount of tools & infrastructure we need and unify them under one hood. Will give it a try, thanks for building this.