Welcome!

Enterprise DevOps, Log Management and Analytics

Sematext Blog

Subscribe to Sematext Blog: eMailAlertsEmail Alerts
Get Sematext Blog via: homepageHomepage mobileMobile rssRSS facebookFacebook twitterTwitter linkedinLinkedIn


Latest Blogs from Sematext Blog
Solr vs. Elasticsearch. Elasticsearch vs. Solr.  Which one is better? How are they different? Which one should you use? Before we start, check out two useful Cheat Sheets to guide you through both Solr and Elasticsearch and help boost your productivity and […]
While some are hallucinating about building walls, we at Sematext are looking to knock them down. One of the Sematext differentiators is that it’s not just a monitoring solution or just log management solution.  Sematext provides monitoring AND log management […]
Logsene, our hosted ELK stack now part of Sematext Cloud, exposes the Elasticsearch API. As a Logsene user you may or may not be aware of this.  If you have experience with Elasticsearch though, if you’re aware of its rich […]
Every modern organization depends on software, and where there is software there are metrics and logs and, one would hope, monitoring of these two critically important types of data. Operations teams have traditionally used two separate sets of tools – […]
People love Splunk. But not its price. So people are always on a lookout for a good Splunk alternative. Many of those people migrated from Splunk to ELK Stack or Hosted ELK Stack solutions like Logsene. The situation with Elastic […]
Note: This is a guest post by Jochen Kressin, the CTO of floragunn GmbH, the makers of Search Guard, an open-source X-Pack Security alternative. Elasticsearch is a great piece of software. We really love it. However, there is one major drawback: […]
Note: This is a guest post by Jochen Kressin, the CTO of floragunn GmbH, the makers of Search Guard, an open-source X-Pack Security alternative. In this article, we show you how to secure Elasticsearch and Kibana for free using the Community […]
Over the last several months we’ve made all kinds of improvements to Sematext Docker Agent (SDA).  If you’re not familiar with SDA yet, here it is in a nutshell Sematext Docker Agent is a modern, open-source, Docker-native monitoring and log […]
We are all used to the Solr API that has been present in Solr from its beginnings. We send the data using HTTP protocol, we include all parameters in the URL itself, and we are bound to that. Some people […]
Being able to see the context of a specific log message is one of those highly sought out  features in Kibana that still seems to be missing (though we can see the light at the end of that long tunnel […]
Up until now, Sematext Cloud users had to first provide their credit card details under their account and then manually assign that credit card to each monitoring or logging App they wanted to use with a paid plan.  It turns […]
Need to have your recent logs searchable for your DevOps team(s) to troubleshoot issues, but also need to archive old logs for compliance reasons?   Many organizations need that and Sematext Cloud makes that simple.  You can certainly simply pick […]
Want to ship logs and other events from your iOS apps?   We’ve open-sourced the iOS SDK for shipping logs from iOS apps to Sematext Cloud.  This library not only lets you send your iOS app logs for troubleshooting purposes, […]
A few months back we’ve silently built and open-sourced an Android SDK for shipping logs from mobile apps to Sematext Cloud.  This library not only lets you send your Android app logs for troubleshooting purposes, but it also let’s you […]
We’ve refreshed not only the Sematext Cloud UI, but also our backend, or one of them at least. Last week, we’ve updated Elasticsearch to the latest 5.x version.  Along with it we’ve updated the integrated version of Kibana to which […]
Need we say more?  If you’ve used Sematext Cloud recently you’ve noticed the UI looks and behaves differently.  Indeed, we rewrote the whoooooole front-end using modern front-end technologies like React.js and Redux (watch this statement become outdated in 12 months!). […]
Besides completely revamping the Sematext Cloud user interface recently (hello ReactJS & Redux!), we’ve also made some changes to how certain features work. One of them is related to Alert Rules and related Notification Hooks (aka Integrations). Previously, Alert Rules […]
This post shows how to use Docker Secrets in Docker Swarm mode. For our example we’ll show how to use Docker Secrets to encrypt and safely store tokens used by Sematext Docker Agent for shipping Docker metrics and logs. Containerized […]
On March 29-30, Cloud NativeCon + KubeCon – Berlin, Germany brings together almost 1500 developers, architects, technical leaders, CIOs, CTOs, and analysts from open source cloud native communities – all under a single roof. Come and learn about Fluentd, Kubernetes, […]
Sematext Solr AutoComplete is an open-source Solr add-on that provides suggest-as-you-type functionality. In this post we’ll explain how you can install it, load the autocomplete collection/core with suggestions and how to run queries to get those suggestions back. Why Sematext [...
In the world of DevOps, metric collection, log centralization and analysis Apache Kafka is the most commonly used middleware.  More specifically, it is used as a fast, persistent queue between data sources like log shippers and the storage that makes […]
Since we work with Elasticsearch and Solr on a daily basis and know so much about them we like helping others improve their knowledge of these technologies, not only through Solr & Elastic Stack trainings, but also by sharing our […]
Intrusion detection systems generate highly valuable logs with network usage details and alerts. They collect vast amounts of data and typically store them in structures with a large number of fields.  To make sense of so much data and to […]
As you know, in Sematext we looooove logs and metrics and we enjoy playing with them on a daily basis. We have our Logsene, which is all about logs and their analysis. We have our SPM which can monitor half […]
When dealing with log centralization in your organization you have to start with something. Often times people start by collecting logs for the most crucial pieces of software, and frequently one chooses to ship them to their own in-house Elasticsearch-based solution (aka ELK stack) or...
Pretty much everyone’s heard about syslog: with its roots in the 80s, it’s still used for a lot of the logging done today. Mostly because of its long history, syslog is quite a vague concept, referring to many things. Which is why you’ve probably heard: Check syslog, ...
Enterprises without DevOps teams and culture typically experience long applications deployment cycles. Once developers make a new release the operations team needs to deploy it to one of the existing or new servers, and it often takes a long time (up to several weeks is not uncommon) t...
The recent ransom attack on public Elasticsearch instances showed that Elasticsearch security is still a hot topic. Elasticsearch was not the only target – tens of thousands of poorly configured MongoDB databases have been compromised over the past week, too, compromising over 27...
One way to create a better search experience is to understand the user intent.  One of the phases in that process is query understanding, and one simple step in that direction is query segmentation. In this post, we’ll cover what query segmentation is and when it is useful. We will als...
2017 is almost here and, like last year, we thought we’d share how 2016 went for us.  We remain committed to be your “one-stop shop” for all things Elasticsearch and Solr: from Consulting, Production Support, and Training, to complementing that with our Logsene for all your logs, and S...
Nowadays there are more and more organizations searching for fault-tolerant and highly available solutions for various parts of their infrastructure, including search, which evolved from merely a “nice to have” feature to the first class citizen and a “must have”...
Running on Elasticsearch on Docker sounds like a natural fit – both technologies promise elasticity. However, running a truly elastic Elasticsearch cluster on Docker Swarm became somewhat difficult with Docker Swarm 1.2. Why? Since Elasticsearch gave up on multicast discovery (by...
Back in 2011 – more than half a decade ago(!) – we’ve reviewed Top JavaScript Dynamic Table Libraries.  Clearly, a lot has changed since then.  Earlier this year, we started reworking our SPM & Logsene front-ends, building them on top of ReactJS, Redux, and ES6.  In the...
In this post we will: Introduce Kubernetes concepts and motivation for Kubernetes-aware monitoring and logging tooling Show how to deploy the Sematext Docker Agent to each Kubernetes node with DaemonSet Point out key Kubernetes metrics and log elements to help you troubleshoot and tune...
Docker is all the rage these days, but one doesn’t hear about running Solr on Docker very much. Last month, we gave a talk on the topic of running containerized Solr at the Lucene Revolution conference in Boston, the biggest open source conference dedicated to Apache Lucene/Solr....
Logging Libraries vs Log Shippers In the context of centralizing logs (say, to Logsene or your own Elasticsearch), we often get the question of whether one should log directly from the application (e.g. via an Elasticsearch or syslog appender) or use a dedicated log shipper. In this po...
This is a guest post by Nedim Šabić, developer of Fibratus, a tool for exploration and tracing of the Windows kernel.  Unlike Linux / UNIX environments which provide a plethora of open source and native tools to instrument the user / kernel space internals, the Windows operating system...
For this Black Friday, Sematext wishes you: more products sold more traffic and exposure more logs
This is a guest post by Prof. Chanwit Kaewkasi, Docker Captain who organized Swarm3K – the largest Docker Swarm cluster to date. Swarm3K Review Swarm3K was the second collaborative project trying to form a very large Docker cluster with the Swarm mode. It happened on 28th October...
Many of our clients use AWS EC2. In the context of Elasticsearch consulting or support, one question we often get is: should we use AWS Elasticsearch Service instead of deploying Elasticsearch ourselves? The question is valid whether “self hosted” means in EC2, some other cloud or your...