# What Clients, Agents, and Ingestion Tools do you use? **URL:** \ **Category:** OpenDistro\ **Created:** [June 18, 2021, 6:39pm UTC](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269 "2021-06-18T18:39:18Z")\ **Posts on this page:** 12\ **Page:** 1
**Author:** ![elifish](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.opensearch.org/elifish/32/1451_2.png) [@elifish](https://forum.opensearch.org/u/elifish)\ **Post date:** [June 18, 2021, 6:39pm UTC](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1 "2021-06-18T18:39:18Z")
Hi everyone, I wanted to learn more about the different tools people use with open source Elasticsearch, Open Distro for Elasticsearch, and OpenSearch. There are a lot of tools in this ecosystem and I want to learn more about what is popular. I would like to use this information to make recommendations on where OpenSearch should add testing, documentation, and other efforts for clients, agents, and ingestion tools. **NOTE:** If there are any tools you are using that aren’t in this list, or if there is anything about one or more of these tools that you particularly like, please leave a comment with more details. Thanks everyone! * * * # Agents _tools that pickup and ship data from the host they are running on_ **Filebeat** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Metricbeat** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Packetbeat** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Winlogbeat** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Heartbeat** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Fluent Bit** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Fluentd** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Vector** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Open Telemetry Collector** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ * * * # Ingestion Aggregators _tools that collect and transform data before shipping_ **Logstash** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Fluentd** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Open Telemetry Collector** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ * * * # Data Streaming _tools that provide data pipelines and shipping to the cluster_ **Apache Kafka** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Apache Flink** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Apache Flume** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ * * * # Clients _SDKs and Client Libraries_ **Open Telemetry libraries** [poll name= otellib results=always min=1 max=1 chartType=bar] - I currently use - I don’t use, but I am interested in using - I don’t use, and I am not interested in using [/poll] **B4J: jElasticsearch** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **C++: elasticlient** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Clojure: Spandex** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Clojure: Elastisch** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **ColdFusion: cbElasticSearch** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Erlang: erlastic\_search** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Erlang: Tirexs** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Erlang: Elixir Bulk Processor** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Go: Official Elasticsearch Client** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Go: elastigo** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Go: elastic** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Go: elk** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Haskell: bloodhound** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Java: Low Level Client** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Java: Official High Level Client** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Java: Flummi** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Java: Jest** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **JavaScript: Official Elasticsearch Client** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Kotlin: ES Kotlin** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Kotlin: ES Kotlin Wrapper Client** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Lua: elasticsearch-lua** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **.Net: Official Elasticsearch Client** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Perl: Official Elasticsearch Client** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Perl: Elastijk** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **PHP: Official Elasticsearch Client** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **PHP: Elastica** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **PHP: elasticsearch** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **PHP: elasticsearcher** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Python: Official Elasticsearch Client** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **R: elastic** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **R: elasticdsl** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **R: uptasticsearch** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Ruby: Official Elasticsearch Client** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Ruby: elastics** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Ruby: chewy** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Ruby: Searchkick** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Ruby: Estella** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Rust: Official Elasticsearch Client** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Rust: rs-es** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Rust: elastic** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Scala: elastic4s** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Scala: escalar** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Scala: elasticsearch-client** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Smalltalk: elasticsearch-smalltalk** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Swift: Elasticsearch NIO Client** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Vert.x: elasticsearch-client** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ **Spring Data Elasticsearch** _Poll ([view on site](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/1))_ ---
**Author:** ![searchymcsearchface](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.opensearch.org/searchymcsearchface/32/868_2.png) [@searchymcsearchface](https://forum.opensearch.org/u/searchymcsearchface)\ **Post date:** [June 18, 2021, 7:47pm UTC](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/2 "2021-06-18T19:47:49Z")
Pinned on June 18, 2021, 7:47pm UTC ---
**Author:** ![robcowart](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.opensearch.org/robcowart/32/1012_2.png) [@robcowart](https://forum.opensearch.org/u/robcowart)\ **Post date:** [June 19, 2021, 5:38am UTC](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/3 "2021-06-19T05:38:56Z")
You missed… “I use, but wish I had a better alternative” ---
**Author:** ![robcowart](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.opensearch.org/robcowart/32/1012_2.png) [@robcowart](https://forum.opensearch.org/u/robcowart)\ **Post date:** [June 19, 2021, 5:49am UTC](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/4 "2021-06-19T05:49:17Z")
Somethings that may be useful to add… - Telegraf - Has an Elasticsearch output and is useful as an alternative to Metricbeat, especially for data sources not supported by Metricbeat or other components from Elastic. - Confluent Elasticsearch Connector for Kafka Connect - While Kafka is on the list, there are lots of ways to use Kafka without Kafka Connect. Personally I am not a fan of Connect and the Elasticsearch Connector, but it is somewhat widely used. - StreamSets and NiFi - I think of both of these as “Logstash with a GUI”. However like most GUIs, they are great for beginners, but eventually they just get in the way… at least IMO. ---
**Author:** ![jkowall](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.opensearch.org/jkowall/32/1063_2.png) [@jkowall](https://forum.opensearch.org/u/jkowall)\ **Post date:** [June 20, 2021, 2:05am UTC](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/5 "2021-06-20T02:05:14Z")
Good additions, we have customers using Telegraf, but we are using M3DB backend for time series 🙂 ---
**Author:** ![ralph](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.opensearch.org/ralph/32/1194_2.png) [@ralph](https://forum.opensearch.org/u/ralph)\ **Post date:** [June 21, 2021, 6:32am UTC](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/6 "2021-06-21T06:32:34Z")
hm, i voted “yes” on Kafka - but we’re not using Kafka Connect, we have our own service in-between which consumes the Kafka messages from the topics we’re interested in, applies transformations and then writes this into ES. should i’ve voted “no”? if so, maybe rename “Kafka” to “Kafka Connect”? ---
**Author:** ![alexz00](https://avatars.discourse-cdn.com/v4/letter/a/cc9497/32.png) [@alexz00](https://forum.opensearch.org/u/alexz00)\ **Post date:** [June 21, 2021, 9:27am UTC](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/7 "2021-06-21T09:27:56Z")
As additional client I would add the Hadoop/Apache Spark Elasticsearch connector: [Elasticsearch for Apache Hadoop [8.4] | Elastic](https://www.elastic.co/guide/en/elasticsearch/hadoop/current/index.html) ---
**Author:** ![elifish](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.opensearch.org/elifish/32/1451_2.png) [@elifish](https://forum.opensearch.org/u/elifish)\ **Post date:** [June 21, 2021, 2:58pm UTC](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/8 "2021-06-21T14:58:24Z")
If you are using Kafka at all in your deployment topology to eventually write to ES or OpenSearch, yes is the way to vote. 🙂 ---
**Author:** ![elifish](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.opensearch.org/elifish/32/1451_2.png) [@elifish](https://forum.opensearch.org/u/elifish)\ **Post date:** [June 21, 2021, 2:59pm UTC](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/9 "2021-06-21T14:59:07Z")
Thanks for sharing these details! I’ll note them down! ---
**Author:** ![hagayg](https://avatars.discourse-cdn.com/v4/letter/h/eada6e/32.png) [@hagayg](https://forum.opensearch.org/u/hagayg)\ **Post date:** [June 22, 2021, 2:55am UTC](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/10 "2021-06-22T02:55:03Z")
. Net seems to be missing the NEST library, the elasticsearch client is the lower level one (same as Java) ---
**Author:** ![SergioFG](https://avatars.discourse-cdn.com/v4/letter/s/b3f665/32.png) [@SergioFG](https://forum.opensearch.org/u/SergioFG)\ **Post date:** [June 24, 2021, 10:55am UTC](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/11 "2021-06-24T10:55:07Z")
Not sure if these two tools fit in with the rest, but we use ElastiFlow for netflow data and Wazuh as a SIEM ---
**Author:** ![elifish](https://sea1.discourse-cdn.com/flex019/user_avatar/forum.opensearch.org/elifish/32/1451_2.png) [@elifish](https://forum.opensearch.org/u/elifish)\ **Post date:** [June 29, 2021, 3:03pm UTC](https://forum.opensearch.org/t/what-clients-agents-and-ingestion-tools-do-you-use/6269/12 "2021-06-29T15:03:18Z")
Closing the poll today. Thanks everyone for filling out the poll!