• Home
  • Site Aliases
    • www.cloud-native.info
    • oracle.cloud-native.info
    • Phil-Wilkins.uk
  • About
    • Background
    • Presenting Activities
    • Internet Profile
      • LinkedIn
    • About
  • Books & Publications
    • Logging in Action with Fluentd, Kubernetes and More
      • Logging in Action with Fluentd – Book
      • Fluentd Book Resources
      • Log Generator
    • API & API Platform
      • API Useful Resources
    • Oracle Integration
      • Book Website
      • Useful Reading Sources
    • Publication Contributions
  • Resources
    • GitHub
    • Mindmaps Index
    • Oracle Integration Site
    • Useful Tech Resources …
      • Oracle Tech Resources inc Open Source
      • Patterns Sources
      • Useful Tech Resources
      • Python Setup & related stuff
  • Music

Phil (aka MP3Monster)'s Blog

~ from Technology to Music

Phil (aka MP3Monster)'s Blog

Tag Archives: Plugin

Avoid creating an event storm when using social outputs with Fluentd

14 Thursday Apr 2022

Posted by mp3monster in Fluentd, General, Technology

≈ Leave a comment

Tags

Fluentd, logging, mail storm, monitoring, Plugin, social, supress

Fluentd has an incredible catalogue of plugins including notification and collaboration channels from good old-fashioned email through to slack, teams, and others.

The thing to remember if you use these channels is that if you’re sending errors, from application logs it isn’t unusual for there to be multiple error events as a root event can cause a cascade of related issues. For example, if your code is writing transactions to a database and the database goes down with no failover mechanism, then your code will most likely experience an error, roll back the transaction perhaps to some sort of queue, and then try to process the next event. Which will again fail. This is the classic situation where multiple errors will get reported for the same issue. This problem is often referred to as a mail storm given that there was a time when we didn’t have social collaboration tools and everyone used email.

There are several ways to overcome this problem. But the most simple and elegant of these is using the suppress plugin in its filter mode.

<filter **>
  @type suppress
  interval 60       # period in seconds when the condition to supress is triggered
  num 2             # number of occurences of a value before suppressing
  attr_keys source  # the element of the event to consider.
</filter>

In this example if we encounter an event with an attribute called source containing the same value twice then the suppression will kick in for 60 seconds. If you want the key to the valuebeing checked to be the tag then simply omit the attr_keys parameter.

Of course, we don’t want the suppression to kick in if the same value in the attribute keys occured once every few hours. To address this the occurence count is applied over not a time period, but a number of events received by the configuration of max_slot_num which defaults to 10k, but resets

In the filter mode, this plugin is best positionbed immediately before the match block. This means we don’t accidentally suppress messages before they are routed anywhere else.

For the purposes of a demo this is less of an issue. But for a realworld use case would probably benefit from some tuning. All the documentation for this plugin is at https://github.com/fujiwara/fluent-plugin-suppress

Share this:

  • Twitter
  • Facebook
  • LinkedIn
  • Print
  • Pocket
  • Email
  • Tumblr
  • Reddit
  • Pinterest
  • WhatsApp
  • Skype

Like this:

Like Loading...

JDeveloper & Copying Formatted Text

13 Monday May 2013

Posted by mp3monster in General, Technology

≈ Leave a comment

Tags

JDeveloper, Plugin, Pretty formatting, XSD

 

I’ve started to use Oracle’s JDeveloper more and more, not just because I’m working with the AIA (Application Integration Architecture) Foundation Pack but also as an XSD Editor for designing interface definitions.

I’ve spent sometime trying to find a solution that can compete with XML Spy but without the huge price tag.  I’ve tried OxygenXML, Eclipse, Visual Studio among others and concluded that its very good for a free tool. Perhaps still not as good as XMLSpy – but thats the difference between an IDE and a dedicated XSD/XML tool.

image JDeveloper design view- with a lot of similarities to XMLSpy in presentation

You might think, that to use JDeveloper I have to commit to using the Oracle technology stack (and the big price tag that comes with), but this isn’t the case.

Not to mention Oracle have very much caught up with the Open Source World of Maven, there is a growing library of plugins both Official and Open Source covering a plethora of things from JUnit integration to Python & Groovy language  syntaxes.

One of the nice things with XMLSpy and VisualStudio is the ability to copy into other documents the pretty formatted text (colour coded syntax etc) – making schemas or code fragments easier to look at in a document.  However out of the box JDeveloper doesn’t do this out of the box. But it would seem that this capability wasn’t just wanted by me, so an extension has been written Chris Hughes that solves this problem called jdev-copyashtml.


<?xmlversion="1.0"encoding="ISO-8859-1"?><xs:schemaxmlns:xs="http://www.w3.org/2001/XMLSchema"><xs:elementname="shiporder"><xs:complexType><xs:sequence><xs:elementname="orderperson"type="xs:string"/><xs:elementname="shipto"><xs:complexType><xs:sequence><xs:elementname="name"type="xs:string"/><xs:elementname="address"type="xs:string"/><xs:elementname="city"type="xs:string"/><xs:elementname="country"type="xs:string"/></xs:sequence></xs:complexType></xs:element><xs:elementname="item"maxOccurs="unbounded"><xs:complexType><xs:sequence><xs:elementname="title"type="xs:string"/><xs:elementname="note"type="xs:string"minOccurs="0"/><xs:elementname="quantity"type="xs:positiveInteger"/><xs:elementname="price"type="xs:decimal"/></xs:sequence></xs:complexType></xs:element></xs:sequence><xs:attributename="orderid"type="xs:string"use="required"/></xs:complexType></xs:element></xs:schema>

 

Once downloaded go to Help –> Check for Updates and step through so you can then choose your download – as shown.

image

Once installed you’ll need to restart JDeveloper.  To then configure to plugin to work as you want go to Tools –> Preferences… Where you should be able to find Copy As HTML/RTF in the left menu tree to get the options to configure the plugin behaviour.

image

If you’re going from Windows application to another then you want the Rich Text Format setting.  After that rather than Ctrl+C its Ctrl+H to copy and carry the pretty formatting/colours etc.

Share this:

  • Twitter
  • Facebook
  • LinkedIn
  • Print
  • Pocket
  • Email
  • Tumblr
  • Reddit
  • Pinterest
  • WhatsApp
  • Skype

Like this:

Like Loading...

Aliases

  • phil-wilkins.uk
  • cloud-native.info
  • oracle.cloud-native.info

Oracle Ace Director Alumni

TOGAF 9

Logging in Action

Oracle Cloud Integration Book

API Platform Book

Oracle Dev Meetup London

Categories

  • App Ideas
  • Books
    • Book Reviews
    • manning
    • Oracle Press
    • Packt
  • Enterprise architecture
  • General
    • economy
    • LinkedIn
    • Website
  • Music
    • Music Resources
    • Music Reviews
  • Photography
  • Technology
    • APIs & microservices
    • chatbots
    • Cloud
    • Cloud Native
    • Dev Meetup
    • development
    • drone
    • Fluentd
    • logsimulator
    • mindmap
    • OMESA
    • Oracle
      • API Platform CS
        • tools
      • Helidon
      • ITSO & OEAF
      • Java Cloud
      • NodeJS Cloud
      • OIC – ICS
      • Oracle Cloud Native
      • OUG
    • TOGAF
  • xxRetired

Twitter

  • Will you be at #KubeCon + #CloudNativeCon? Be sure to swing by @Oracle's booth to learn about career opportunities… twitter.com/i/web/status/1…Next Tweet: 16 hours ago
  • Easily move existing #OpenSearch workloads to reduce costs and administrative overhead with @OracleCloud Infrastruc… twitter.com/i/web/status/1…Next Tweet: 21 hours ago
  • If you are looking for a high-level view of comparable services from the cloud providers, check this page:… twitter.com/i/web/status/1…Next Tweet: 23 hours ago
  • Container Registry – pushing and storing containers blog.mp3monster.org/2022/05/12/con…Next Tweet: 1 day ago
  • RT @goflexagon: Are #DevOps and #CICD really that important? Or are they just shiny objects? Dan Goerdt, President of Flexagon, dives into…Next Tweet: 2 days ago
Follow @mp3monster

OraWorld

OraWorld

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 607 other followers

Blogs I Follow

  • Site Title
  • All about modern software technologies & architectures
  • Rick's blog
  • A journey in development
  • Phil (aka MP3Monster)'s Blog
  • RedThunder.Blog
  • A millennial's musings
  • Shalindra's Blogs
  • BTplusMore
  • Creativenauts
  • PaaS Community Blog
  • RedStack
  • Musings of an Enterprise Software Technologist
  • The Open Group Blog
  • SutoCom Solutions
  • Rob's Wall Of Music
  • DataCentricSec.com
  • A World of Events

My Other Web Content & Contributions

  • All My Links
  • Amazon Author entry
  • API Platform
  • Dev Meetup (co-managed)
  • Fluentd Book
  • GitHub
  • http://phil-wilkins.uk/
  • ICS Book Website
  • Mindmaps
  • Monster's Photos
  • my Capgemini Profile
  • OMESA
  • Oracle Community Directory
  • Packt Author Bio
  • Phil on Blogs.Oracle.com

RSS

RSS Feed RSS - Posts

RSS Feed RSS - Comments

Calendar

May 2022
M T W T F S S
 1
2345678
9101112131415
16171819202122
23242526272829
3031  
« Apr    

Other Pages

  • About
    • Internet Profile
    • Presenting Activities
  • Books & Publications
    • API & API Platform
      • API Useful Resources
      • Useful Reading Sources
    • Logging in Action with Fluentd, Kubernetes and More
    • Oracle Integration
  • Mindmaps Index
    • Patterns Sources
  • Useful Tech Resources
    • Oracle Tech Resources inc Open Source
    • Python Setup & related tips

Speaker Recognition

Open Source Summit Speaker

Flickr Pics

Sound InstallationSound InstallationSound InstallationSound Installation
More Photos

History

Goodreads

OraNA

Aggregated by OraNA

Blogroll

  • A Journey in Development
  • A Neate Blog
  • Amy Simpson Grange blog
  • Blog by Robert van Mölken (co-author on ICS book)
  • Developer Community
  • Exigency In Specie
  • Flexagon (FlexDepoy)
  • GitHub
  • http://phil-wilkins.uk/
  • Ora World
  • PaaS Community
  • SOA4U

Calendar

May 2022
M T W T F S S
 1
2345678
9101112131415
16171819202122
23242526272829
3031  
« Apr    

Categories

  • App Ideas
  • Books
    • Book Reviews
    • manning
    • Oracle Press
    • Packt
  • Enterprise architecture
  • General
    • economy
    • LinkedIn
    • Website
  • Music
    • Music Resources
    • Music Reviews
  • Photography
  • Technology
    • APIs & microservices
    • chatbots
    • Cloud
    • Cloud Native
    • Dev Meetup
    • development
    • drone
    • Fluentd
    • logsimulator
    • mindmap
    • OMESA
    • Oracle
      • API Platform CS
        • tools
      • Helidon
      • ITSO & OEAF
      • Java Cloud
      • NodeJS Cloud
      • OIC – ICS
      • Oracle Cloud Native
      • OUG
    • TOGAF
  • xxRetired

Twitter

  • Will you be at #KubeCon + #CloudNativeCon? Be sure to swing by @Oracle's booth to learn about career opportunities… twitter.com/i/web/status/1…Next Tweet: 16 hours ago
  • Easily move existing #OpenSearch workloads to reduce costs and administrative overhead with @OracleCloud Infrastruc… twitter.com/i/web/status/1…Next Tweet: 21 hours ago
  • If you are looking for a high-level view of comparable services from the cloud providers, check this page:… twitter.com/i/web/status/1…Next Tweet: 23 hours ago
  • Container Registry – pushing and storing containers blog.mp3monster.org/2022/05/12/con…Next Tweet: 1 day ago
  • RT @goflexagon: Are #DevOps and #CICD really that important? Or are they just shiny objects? Dan Goerdt, President of Flexagon, dives into…Next Tweet: 2 days ago
Follow @mp3monster

Flickr Pics

Sound InstallationSound InstallationSound InstallationSound Installation
More Photos

My Other Web Content & Contributions

  • All My Links
  • Amazon Author entry
  • API Platform
  • Dev Meetup (co-managed)
  • Fluentd Book
  • GitHub
  • http://phil-wilkins.uk/
  • ICS Book Website
  • Mindmaps
  • Monster's Photos
  • my Capgemini Profile
  • OMESA
  • Oracle Community Directory
  • Packt Author Bio
  • Phil on Blogs.Oracle.com

Enter your email address to subscribe to this blog and receive notifications of new posts by email.

Join 607 other followers

History

Other Pages

  • About
    • Internet Profile
    • Presenting Activities
  • Books & Publications
    • API & API Platform
      • API Useful Resources
      • Useful Reading Sources
    • Logging in Action with Fluentd, Kubernetes and More
    • Oracle Integration
  • Mindmaps Index
    • Patterns Sources
  • Useful Tech Resources
    • Oracle Tech Resources inc Open Source
    • Python Setup & related tips

RSS

RSS Feed RSS - Posts

RSS Feed RSS - Comments

Social

  • View @mp3monster’s profile on Twitter
  • View philwilkins’s profile on LinkedIn
  • View mp3monster’s profile on GitHub
  • View mp3monster’s profile on Flickr
  • View philmp3monster’s profile on Twitch
Follow Phil (aka MP3Monster)'s Blog on WordPress.com

Blog at WordPress.com.

Site Title

All about modern software technologies & architectures

Cloud-native, technology and software architecture

Rick's blog

End-to-End OIC to SAP integration

A journey in development

A blog-post by blog-post journey of a ERP Cloud Solutions Degree Apprentice

Phil (aka MP3Monster)'s Blog

from Technology to Music

RedThunder.Blog

Demystifying cloud technologies...

A millennial's musings

Shalindra's Blogs

Technofunctional Blogs

BTplusMore

Business, Technology and more

Creativenauts

Personal, design, inspiration, interests.

PaaS Community Blog

by Jürgen Kress

RedStack

Oracle Database and Cloud Stuff

Musings of an Enterprise Software Technologist

My thoughts on Enterprise Software Technologies...and more.

The Open Group Blog

Achieving business objectives through technology standards

SutoCom Solutions

Success & Satisfaction with the Cloud

Rob's Wall Of Music

Thoughts of a lifelong music hoarder...

DataCentricSec.com

A World of Events

A Blog for Event and Data Analytics

  • Follow Following
    • Phil (aka MP3Monster)'s Blog
    • Join 607 other followers
    • Already have a WordPress.com account? Log in now.
    • Phil (aka MP3Monster)'s Blog
    • Customize
    • Follow Following
    • Sign up
    • Log in
    • Report this content
    • View site in Reader
    • Manage subscriptions
    • Collapse this bar
loading Cancel
Post was not sent - check your email addresses!
Email check failed, please try again
Sorry, your blog cannot share posts by email.
Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
To find out more, including how to control cookies, see here: Our Cookie Policy
%d bloggers like this: