Extract user_agent fields from logs using AWS ElasticSearch

ElasticSearch service has become one of the preferred services where sysops department store logs and metrics information. Recently, we faced with a problem that we already solved related with the user_agent field we get from nginx json logs. When a new request transaction goes to our web services we want to get some certain relevant […]

Indexing HAProxy custom HTTP headers into Elasticsearch

Elasticsearch is a tool that allows indexing many types of content such as application logs, and in this article we will deal precisely with how to index the HTTP logs of a load balancer and proxy such as HAProxy, in the case of wanting to also record the fields of User-Agent, X-Forwarded-For and Referrer, which […]