Welcome!

Enterprise DevOps, Log Management and Analytics

Sematext Blog

Subscribe to Sematext Blog: eMailAlertsEmail Alerts
Get Sematext Blog via: homepageHomepage mobileMobile rssRSS facebookFacebook twitterTwitter linkedinLinkedIn


Blog Feed Post

S3 Archiving & Longer Retention for Logs

Need to have your recent logs searchable for your DevOps team(s) to troubleshoot issues, but also need to archive old logs for compliance reasons?  

Many organizations need that and Sematext Cloud makes that simple.  You can certainly simply pick a longer data retention option along with your plan and daily log volume.  Doing that makes all your logs searchable for a long time.  If, however, you simply need to store your older logs, so that you can retrieve them later on, but do not need to search them, you can use S3 Archiving option provided by Sematext Cloud.  

All you need to provide are Access Key ID, your Secret Access Key, and the name of the S3 bucket where you want your logs to be archived.

Sematext S3 Archivinghttps://sematext.com/wp-content/uploads/2017/05/Payment-Logic-Changes-30... 300w, https://sematext.com/wp-content/uploads/2017/05/Payment-Logic-Changes-76... 768w, https://sematext.com/wp-content/uploads/2017/05/Payment-Logic-Changes-10... 1024w" sizes="(max-width: 2558px) 100vw, 2558px" />

Logs are archived continuously in your bucket, organized by time:

sematext_[app-token-start]/[year]/[month]/[day]/[hour].  

Compression is optional, but if your log volume is high, we recommend you enable it to save on S3 costs.  Sematext will need s3:PutObject credentials on your bucket.  s3:GetObject and s3:DeleteObject are needed only temporarily, when setting up archiving to S3, and can be revoked right after that. See Sematext Logs S3 Archiving for more info.



 

Read the original blog entry...

More Stories By Sematext Blog

Sematext is a globally distributed organization that builds innovative Cloud and On Premises solutions for performance monitoring, alerting and anomaly detection (SPM), log management and analytics (Logsene), and search analytics (SSA). We also provide Search and Big Data consulting services and offer 24/7 production support for Solr and Elasticsearch.