The relationship between Sanofi Aventis Group and Moviri dates back to 2014 when Moviri first engaged with the leading multinational pharmaceutical company to implement BMC’s Truesight Capacity Optimization solution. Sanofi was tasked with the ambitious goal of setting up the foundation of a world-class capacity management process. As the solution was implemented, Sanofi also decided to take advantage of Moviri’s Managed Service offering to support BMC’s TrueSight Capacity Optimization Solution on a daily basis.
At BMC Engage 2014 in Orlando, Sanofi and Moviri held a joint presentation to discuss how they effectively managed growth within Sanofi and continuously aligned IT to business demands.
The partnership between Sanofi and Moviri continues to grow stronger as Moviri has become a key partner and a trusted advisor for Sanofi’s global challenges. Each customer relationship is personal to Moviri and we strive to treat our customer’s needs as if they were our own.
Chris Wimer, Global Capacity Manager at Sanofi, has written a recommendation letter to endorse a leading Moviri consultant’s services and work ethic throughout his time while working with Sanofi.
Here is an excerpt from the letter:
“I am responsible for Capacity Management within the Application Technology and Solutions (ATS) and Global Infrastructure Services (GIS) groups at Sanofi. As Global Capacity Manager, I provide services to a variety of different internal and external Customers, including administration, support, operation and extension of the BMC TrueSight Capacity Optimization (TSCO) infrastructure” […]
“If you are considering engaging a strategic partner with expertise in Capacity Management processes, or you’re interested in getting the best out of your BMC TrueSight Capacity Optimization instance, I would recommend meeting with Moviri and discuss how they can help you achieve your objectives.”
Moviri is greatly appreciative of the opportunity to partner with a market leader such as Sanofi. We take tremendous pride and understand the importance of supporting Sanofi to ensure their enterprise applications are running faster, using less resources and meeting business demands, Moviri’s core mission.
Impresacity.it point of view at Splunk! Live Italy, on how three customers have gained significant business benefit from working with Moviri and Splunk to find the value in their machine data (here is the recap of the event from Splunk Blog).
L’intelligenza operativa della piattaforma Splunk
Lo sfruttamento dei big data e le analisi che se ne possono ricavare sono da tempo oggetto di riflessioni, sperimentazioni o sviluppi di nuovi progetti nelle aziende. In questa fase storica, si inizia a concretizzare un’evoluzione di questi concetti, che si sostanzia in quello di “intelligenza operativa”, in pratica una fase due della business intelligence, alla quale si abbina la capacità di costruire flussi di informazioni in tempo reale per ottenere analisi più raffinate e puntuali partendo da grandi quantità di dati grezzi.
Le aziende potenzialmente più interessate a questa evoluzione sono quelle che hanno già abbracciato (o stanno per farlo) i processi di trasformazione digitale, centrano componenti importanti della propria attività sulle informazioni e impostano il loro lavoro su metriche di business controllate con stringente regolarità in aree come i volumi di ordini o gli indicatori di soddisfazione dei clienti, ma anche le rilevazioni sugli incidenti di sicurezza o dati più tecnici.In termini di utilizzo, l’intelligenza operativa real time si sostanzia nel transaction monitoring, che consente a un’azienda di sapere cosa accade, ad esempio, sul fronte commerciale in ogni momento. Le visualizzazioni avvengono attraverso dashboard grafiche di lettura il più possibile semplice, per comprendere lo stato di un’attività in relazione agli obiettivi prefissati.
La premessa serve per riassumere ciò che, in quest’ambito, fa una realtà come Splunk, da qualche tempo presente anche in Italia e con un lotto di clienti apparentemente soddisfatti, al punto da utilizzare la piattaforma per attività anche differenti da quelle che avevano ispirato l’iniziale acquisto.Le ultime evoluzioni dell’offerta si sostanziano in Splunk Enterprise 6.4 e nella sua versione Cloud: “Obiettivo della tecnologia è la riduzione dei costi di storage dei dati storici – spiega Curzio Trezzani, Partner Account Manager South Europe di Splunk -. Il software è stato costruito per catturare, indicizzare e correlare dati in tempo reale, convogliandoli in un repository dal quale generare grafici, report, alert, dashboard o altre visualizzazioni”.
Attorno al nucleo centrale, Splunk ha sviluppato varie app, come It Service Intelligence, una soluzione di monitoraggio che offre un approccio machine-data driven per fornire una visibilità completa sulla salute operativa e i Kpi dei servizi It e infrastrutturali da tenere sotto controllo. User Behavior Analitycs (Uba), invece, aiuta le organizzazioni a individuare le minacce, note o meno note, ai sistemi informativi, utilizzando machine learning, analisi comportamentale, data science e correlazioni avanzate.
Una flessibilità verificata sul campo
Una delle prerogative della tecnologia Splunk è che le app possono essere costruite in modo abbastanza veloce dagli stessi clienti, in base alle loro esigenze. Unicredit, per esempio, ha implementato la piattaforma nel 2010 per analizzare problematiche di incidenti sui sistemi o sulla sicurezza, coinvolgendo, se necessario, anche persone esterne come gli sviluppatori: “Oggi siamo evoluti verso un vero e proprio Siem, utilizzato come soluzione principale per il monitoraggio e il troubleshooting interno – precisa Stefano Guidobaldi, Ict Advanced Engineering del gruppo bancario – per coprire varie applicazioni, dall’Internet banking ai pagamenti con carte. Raccogliamo 2,5 Tb di dati al giorno da 180 fonti diverse, possiamo fare analisi più precise e abbiamo così risolto vari problemi collegati ai Pos, a report prima gestiti con Excel o ai log derivati dai contact center”.
Per Saipem, invece, il rapporto con Splunk parte qualche anno fa per gestire la problematica del log management, ma nel corso del tempo l’utilizzo della piattaforma si è esteso al controllo di vari indicatori gestionali, al monitoraggio del backup multipiattaforma, per intraprendere lo scorso anno un percorso più strutturato verso l’enterprise security: “La soluzione si adatta a differenti esigenze ed è in grado di elaborare qualunque tipologia di dati, per restituire informazioni di valore – commenta l’infrastructure architect Massimo Pessina -. Di fatto, oggi disponiamo di un unico portale di servizi per tutti gli It regional manager, con dati in tempo reale su infrastruttura, applicazioni e sicurezza. La sostituzione del precedente Cmdb proprietario e l’utilizzo anche come strumento per il software inventory sono altri effetti legati all’estrema flessibilità della piattaforma”.
Interessante anche la testimonianza di Yoox Net-à-Porter, specialista nella vendita di abbigliamento solo online, con 40 siti dove si commercializzano prodotti multimarca. Anche qui si può registrare un’evoluzione che ha portato la società da una filosofia technology-centric a una info-centric: “All’ottimizzazione dei processi legati alla sicurezza aziendale, con un’unica dashboard che li condensa tutti in modo chiaro – specifica il responsabile dell’information security Gianluca Gaias – abbiamo aggiunto la pattern recognition, che che porta all’attenzione degli specialisti di sicurezza i dati veramente significativi, forieri di attacchi dei quali occuparsi con attenzione”.
Here at Moviri we are more than accustomed to talk about performance, although this time it’s all about heartbeat peaks and blood flow.
A well represented group of Movirians participated to the 1st PolimiRun, a non-competitive 10km run organized by Politecnico di Milano throughout the city, from Bovisa to Leonardo campus.
Our racing team did a great performance, running together with a smile as they already do on our IT projects. We are also pleased that our contribution supported the scholarship program of Politecnico di Milano.
You can find some finish line celebrating moments in the gallery below.
Driving Italian Operational intelligence at UniCredit, Yoox/Net-A-Porter & Saipem
Last week we ran SplunkLive! Italy in Milan and Rome. I was lucky enough to be in Milan and spend some time with the Splunk team but also one of our key partners, Moviri. We’ve been working with Moviri for many years and together we have delivered some outstanding examples of Operational Intelligence using machine data. Moviri is a leader in IT optimization in Italy, focusing on security, analytics, and monitoring operations. The customer speakers in Milan were UniCredit, Yoox/Net-A-Porter and Saipem. UniCredit presented their excellent story on delivering IT Operational Analytics, Yoox presented real-time security intelligence and Saipem presented on how they use the platform for multiple use cases in Oil and Gas. All three customers have gained significant business benefit from working with Moviri and Splunk to find the value in their machine data:
First up was UniCredit (their case study can be found here) who index 2.5TB of data a day, which is around 8bn events. This real-time data comes from over 180 different sources. Together with Moviri, UniCredit has built out an Operational Intelligence capability to deliver and optimize business analytics, application delivery, IT Operational Analytics (ITOA) and accounting. The UniCredit team describes Splunk as a data engine for IT and the bank. They’ve even gone as far as to replace Excel spreadsheets with interactive Splunk dashboards. My favourite quote of the day was Stefano from UniCredit stating “with Splunk you can see the forest AND the trees.” That sounded even better in Italian than in English.
After a break for some most excellent Italian espresso, we were straight into Saipem and how, together with Moviri’s expertise, they are using the Splunk platform to drive value from the same machine data across multiple use cases.
Saipem has 114 remote sites, 46 vessels, 3000 servers (of which 85% are virtual), 90 satellite links, 50 VOIP call managers and 300 videoconference endpoints (that works out at around 5 petabytes of data generated per day). Saipem collects machine data from its network, endpoints, IT infrastructure and servers. The full presentation is below but they spoke about a single, real-time dashboard for security monitoring showing infrastructure and application status together with user categorization. They also presented another security dashboard that shows every pillar of their security architecture, highlighting anomaly detection and predictive analysis. From an IT Operations perspective, the Saipem team is doing some equally impressive things with their machine data. They’ve built a CMDB app on Splunk to be able to browse their IT infrastructure for device geolocation and worldwide control. They’ve then extended this into software inventory, license utilization and economics analytics. Saipem has a single dashboard for all of their monitoring alerts but are also monitoring application availability for ISO27001 compliance.
Last and by no means least was Yoox/Net-A-Porter. If you’ve ever shopped online with Yoox or Net-A-Porter – you’re not alone. They process an order every 4 seconds from over 180 countries with data centers in the US, UK, Italy, China, Hong Kong and Japan. This equated to over 27 million customers and 7 million orders a year. They power a number of the world’s leading fashion brands online such as Armani, D&G, Moncler, Valentino etc. Needless to say, ensuring cybersecurity and preventing attacks is key. Yoox presented how the company has moved from a technology-oriented approach to security to an information-oriented approach by using machine data. From forensic investigation and risk management to pattern recognition and monitoring the activity of a potential attacker, Yoox gave some great advice on how to use Splunk for real-time security intelligence and how to deliver context-aware security information.
Thank you everyone who came to SplunkLive! Milan and thank you to Moviri for ensuring such wonderful customers got so much value from their machine data and Operational Intelligence. You can find out more about the Moviri and Splunk relationship here.
In this post, I’ll go through some interesting hints around the “performance data reporting”. Even if this is not a fancy or trending topic the solutions proposed address issues that are quite common (and often underestimated) for most performance engineer. Due to the increase of complexity, data sources and therefore KPI over last years, to assess or just to monitor a service (web or mobile application) became a nightmare: find the “rotten apple” is definitely not an easy task.
The two speeches that I picked-up provide different point of view to the “performance data reporting”. From one side there is the pure theoretical & mathematical approach provided by Heinrich Hartmann (Chief Data Scientist at Circonus – @heinrichhartman) in Statistics for Engineers. On the other side, we have the customer centric view offered by Simon Hearne (Senior web performance technical consultant at NCC Group – @simonhearne) in Beyond the waterfall – meaningful web performance visualizations.
One of the most interesting step of the Heinrich speech has been on a quite common problem: how can we provide a synthetic view of the available data without losing relevant information? Or, as he more accurately said – given a bunch of data points how can we:
characterize the distribution in one or two values;
have a characterization robust to outliers.
The following charts provide a clear example to this kind of problem: peak erosion caused by aggregation.
In the two graph, the same peak is shown with height 0.08 and 0.03 due to the aggregation applied to chart the same data over different time spans.
Two the solutions presented by Heinrich:
1- Histogram Aggregation
2- Max Aggregation
A second interesting hint provided by the data scientist is about the use and abuse of the standard deviation as typical displacement from the mean value. Std. dev. is popular because everybody learns about it at school and it has extremely nice mathematical properties as:
68% of data falls within 1 std-dev of the mean;
95% falls within 2 std-dev of the mean;
99.7 falls within 3 std-dev of the mean.
Problem is “this is utter nonsense” since all these properties are true only for normally distributed data! When was the last time that you check about your data distribution? Moreover std. dev. is definitely not good to measure outliers.
So how can we represent the displacement from the mean value? Heinrich suggest to keep in mind that we have other options… do you know the mean abs. dev.?
EDIT 01/27/2016: As suggested by Heinrich Hartmann in the comments, the best alternative to std. deviation measures are provided by quantiles (e.g. 99%-quantile) or quantile-based measures like the inter quartile range (span between 75% and 25% percentile).
As anticipated, the speech from Simon Hearne, provides a more customer centric approach, based on the assumption that as performance consultant: our job is to find the best visualizations to support our story; in order to present and share our findings with not technical people in an easy and understandable way.
The following chart provides a Simons analysis of the common data visualization approaches for web performance data.
In his opinion what are we missing is an intuitive way to provide live info about the performance of a whole site.
His solution is the “rum wall” (following chart), a data visualization based on the common google analytics data. Each box of the wall represents a site’s page: the length of the box is the page exit rate, the height is the page views count, while the color is given by the relative performances (resp. time increases from green to red).
A “rum wall” is hence able to show if and where you have to focus your analysis: the page linked to a big red box has for sure a problem!
If you use google analytics in your site you can try the rum wall using the following link: rumwall.webperf.tools …. but don’t forget to thanks Simon for sharing his ideas and tools!
Attend the Velocity 2015 conference in Amsterdam has been an amazing experience. In just 3 days I collected tons of information and ideas directly from the most innovative and smart people active on topics like web operations, performance and DevOps. If you want to build & deliver sites, apps and services that are fast, scalable, resilient, and highly available to be at the Velocity conference is a must!
There were so many interesting sessions that I wished I was able to travel across space and time to attend them all, but I’m not quite there yet, so I had to pick some. I mostly focused on sessions in the Performance and Metrics & Monitoring categories and would like to spend few words about those I enjoyed the most.
Extreme web performance for mobile devices by Maximiliano Firtman (@firt). I totally agree with him on “responsive design” is a mean and not the end goal for user experience. I believe any of us has at least once used a awesome-looking website with terrible performance, and I also believe that the overall experience was unsatisfactory for the majority of us. He also gave very convincing numbers about how complex is to have consistent performance given the extreme diversity in mobile device configurations.
Measuring the performance of single page web applications by Nic Jansma (@nicj) and Philip Tellis (@bluesmoon). Frameworks are nice and speed up coding, custom framework are even nicer because grant total control, but can turn into a nightmare when it come to troubleshooting performance problems. Especially when the framework you’ve coded against override the standard navigation timing and resource timing API and your monitoring tool is ineffective and leaves you in the dark.
Building real-time metrics pipelines by Samantha Quiñones (@ieatkillerbees). Publicly stating you’ve failed is never easy, and saying you failed three times is even harder, unless you understand the meaning behind “fail fast, fail cheap” mantra. She understands it very well and now her system is live, meets performance expectation, and most importantly generate business value for her company.
Alert overload: How to adopt a microservices architecture without being overwhelmed with noise by Sarah Wells (@sarahjwells). She definitely is not afraid of the (in)famous “microservices deathstar” (simply google it for some examples), and not because she’s a Jedi (well, maybe she is) but because she defined and thoroughly executed a strategy to address the challenges of monitoring such architectures.
As a Movirian, Velocity Conference is a great place where to learn from peers, to bring them your experience from successful projects and to have fun.
Amsterdam installment of 2015 Velocity Conference was all about building end-to-end optimization through rapid development, continuous deployment, deft instrumentation, and automated feedback loops. DevOps together with Microservices, Container, and Optimization were the words most used during speeches and keynotes. Well, no surprises here if you think that those IT organizations that embraced their underlying concepts emerged as clear leader and innovators (Netflix, Uber, Facebook, and the like).
Keynotes were inspiring and fun, here are some takeaways:
A team of three people can move all your services to a new datacenter overnight from hotel wifi connection, provided you have the right bottle of whiskey (Genesis: Terraforming a New Home for Firefox Crash Reporter – JP Schneider & Daniel Maher);
Most probably your next customer will come from the Asia given the projected population will be 5 billion by 2050 and forecasted online retail spending for China only will be 1 trillion USD by 2019 (Ensuring a High Performing Web for the Next Billion People – Bruce Lawson);
Conversational computing which you can think of as the evolution of current personal digital assistants like Siri (Apple), Iris (Android), Cortana (Windows) is fast progressing although you can only either fly a drone or have it take a picture, but not at the same time (A Day in the Life: An Immersive Data Experience – David Boloker).
Looking at tools in the APM domain, there are two clear trends driving their roadmaps: 1) ease of deployment and administration so that you no longer need to ask your precious systems, dba, and middleware experts to take care of them (much more true for SaaS deployment options); 2) increase of capabilities and features coming from the Analytics domain with the goal of making it easier to slice and dice data and better monitor what matters.
This will probably lead to all-in-one offering fitting for small organization or project with low complexity, while big organizations will keep building their best of breed solution out of market offerings.
The Alamo Mission, part of the San Antonio Missions UNESCO World Heritage Site in San Antonio, Texas.
We had the pleasure of sponsoring and attending the Performance & Capacity 2015 in San Antonio (TX), the 41th US National Computer Measurement Group (CMG) conference.
The Computer Measurement Group is a not-for-profit, worldwide organization of IT professionals committed to sharing information and best practices focused on ensuring the efficiency and scalability of IT service delivery to the enterprise through measurement, quantitative analysis and forecasting.
What we like the most about CMG conferences is the unique opportunity to get in touch with top capacity and performance professionals, working on different industries and organizations around the globe. It is a pleasure and a privilege to sit together and share experiences and ideas about how to approach actual performance and capacity planning problems! Plus, it is also a great occasion for networking with our customers and prospects, getting to know each other in person and spending some relaxing time outside of the conference hotel.
As Moviri, we have a long tradition of attending CMG conferences to share our best practices and constantly keeping up to date with the advancements of our capacity and performance field.
However, this year was special for us as we not only managed to get a paper approved for this year conference (second year in a row!), but our Stefano Doni had the honor of receiving the conference Best Paper award! We feel especially delighted for this important recognition and wish a huge thanks to all the referees that spent their time reviewing our paper and providing very useful feedbacks! We’re proud of this international award, we think it speaks for itself about the quality of what Moviri delivers.
Plus, Renato Bonomini managed to deliver an outstanding vendor tool talk on “Business Capacity Modeling with BMC TrueSight Capacity Optimization”, regarded as one of the most appreciated sessions by the attendees – great work Renato!
As usual, we also had a vendor booth which enabled us to present our offerings to US prospects and talk with customers & BMC partners. Thank you Jon!
Best Paper: Lessons from Capacity Planning a Java Enterprise Application: How to Keep Capacity Predictions on Target and Cut CPU Usage by 5x
What is this work all about? Suppose you need to estimate if your user facing service will be able to cope with the increased traffic of your most important business campaign. The stakes are high, you can’t be wrong or the business will be severely impacted. Chances are that your capacity predictions will fall short and the service will *crash* well before the estimated capacity will be reached. In this talk, we described actionable methodologies that we developed over years of capacity planning business critical Java enterprise applications.
Overall, the session has been very well received, we got a lot of questions and interesting feedbacks – thank you!
On Dec. 10th 2015, we held a #movinar, a webinar ran by movirians, on the Best Paper topic. If you didn’t attend the conference and neither the webinar, here is the registration. Enjoy! (If you have any questions, let us know by using the comment box below.)
[Post updated on Feb. 2016]
CMG Session Highlights
As always, CMG is packed with many interesting sessions, selecting and summarizing the best ones is no easy task! Here are two of the most interesting sessions we have attended.
Hadoop super scaling
Outstanding talk by the great Neil Gunther on Hadoop scalability. Hadoop is the most common widely deployed big data framework. Despite its popularity, its performance characteristics are not well understood and the myth of linear (or even super-linear!) scalability is commonly thought among big data developers. Neil shed some light on the real Hadoop scalability and debunked the super-linear scalability myth.
Identify the cause of high latencies in Storage Traces Using Workload Decomposition and Feature Selection
Very good talk by Daniel Myers, a PhD and CS professor who also worked on modeling storage systems @ Google. The proposed methodology allows the identification of the real cause of high latency in storage systems using machine learning. For example, the method can identify which factors (among any) contributes the most to high storage latency, for example high IOPS, high randomness, burstiness and so on. The method was tested against production storage traces collected from Microsoft servers and was able to provide interesting results: nice work!
It’s been a real pleasure to attend this year CMG conference. It was packed with super interesting sessions, we enjoied networking with a lot with customers and partners and were delighted to share an award-winning Moviri-developed capacity planning methodology, hopefully contributing to advancing the capacity planning field with a new actionable approach.
Are you puzzled by our findings and would you like to know if the same is happening to your infrastructure and Java applications? Feel free to get in touch with us, we’re here to help you!
Managing the capacity and efficiency of business-critical Java applications is challenging. At the next Computer Measurement Group’s 41th International Conference Performance & Capacity 2015 from November 2nd to November 5th in San Antonio, Texas, Moviri will give you actionable solutions.
We are delighted and honored to receive the prestigious 2015 Computer Measurement Group Best Paper Award. The award is CMG’s recognition for papers judged exemplary by industry peers and reflecting the best of the best offered at the conference.
Andrea Gallo and Renato Bonomini of Moviri report from the Willis Tower, which hosted the BMC Technology Day 2015 in Chicago on March 11th. BMC Software showcased the updated TrueSight portfolio and for Moviri it was the perfect opportunity to discuss trending technologies and solutions with customers and partners.
The event at the Willis Tower (formerly Sears Tower and for 25 years the tallest building in the world) was organized in five different rooms, one for each BMC portfolio pillar in the distributed world , where each room hosted several sessions where attendees shared success stories and use cases. Herb Van Hook, BMC’s VP and Deputy CTO, and Tony Seba, lecturer from Stanford University, delivered the opening keynote. Similarly to BMC Engage 2014 in Orlando, the keynote focused on the new “Digitalization era” and on what is everyone’s position on these new disruptive technologies. No matter what you or the market think, the future is now!
The break-out sessions included discussions around several topics – let’s summarize the hot ones:
Less click, more value – Ease of access to the important information, tailored to customer needs (the Vodafone experience with SmartIT).
Power is nothing without control – infrastructure continuously growing in dimension and complexity, with companies aiming to achieve clearer visibility of its composition and status.
Disruptive Benefits with IT Cost Transparency – how BMC TrueSight Capacity Optimization helped HCSC.
What it takes to be a Capacity Planner – the journey from a simple spreadsheets to a full-blown and mature Business Aware Capacity Management system and the skills that help in the job.
Two sessions in particular saw Moviri being mentioned several times in Performance Management & Analytics:
Session 2: Customer Case Study Health Care Services Corp (HCSC)
Our friend Ben Davies from Health Care Services Corporation set the motto of the day to “suck less” while describing the journey that enabled cost transparency at HCSC. The key business benefits, as Ben mentioned, were achieved with Moviri’s help to get onto the right direction and avoid “shooting ourselves in the head”, to the point where HSCS scaled the process from “1 to 150 applications in 90secs”.
Session 4: Proactively Adapting to Changes in IT – Customer and Product Mgmt. Q&A Panel
Moviri joined a very interesting Q&A Panel, moderated by Clem Chang of BMC Software, where participants were able to share their thoughts on the topic ‘Future trends of IT’. Renato, together with BMC software consultants and product managers, had the chance to share the vision and discuss how to proactively adapt to an ever changing IT world. The hottest topics discussed were:
Big Data & Cloud – How can IT Operations and Capacity Managers support these technologies? Moviri is in the front line and we are ready to announce new solutions for capacity of big-data.
A single console to rule them all – Is there a plan to merge all of the different consoles into a unified platform? Having an holistic view is the greatest help to connect the dots and stay ahead of application failures. Furthermore, the introduction of IT Data Analytics is designed to streamline operations to find and resolve outages causes as quickly as possible.
“We can’t find good capacity planners!” – a few organizations attending the panel pointed out that it’s very hard to find capacity planners with any level experience.
The Moviri team in Chicago shared what some of the key skills and common profiles of good capacity specialists are. That is, after all, what Moviri does best. If you are looking for some solid capacity skills, make sure you take a minute to talk to our experts.