Remember that time when IBM’s Watson went to Hollywood with the First “Cognitive Movie Trailer” and it was a horror flick?

Posted on

How do you create a movie trailer about an artificially enhanced human?

You turn to the real thing – artificial intelligence.

20th Century Fox has partnered with IBM Research to develop the first-ever “cognitive movie trailer” for its upcoming suspense/horror film, “Morgan”. Fox wanted to explore using artificial intelligence (AI) to create a horror movie trailer that would keep audiences on the edge of their seats.

Movies, especially horror movies, are incredibly subjective. Think about the scariest movie you know (for me, it’s the 1976 movie, “The Omen”). I can almost guarantee that if you ask the person next to you, they’ll have a different answer. There are patterns and types of emotions in horror movies that resonate differently with each viewer, and the intricacies and interrelation of these are what an AI system would have to identify and understand in order to create a compelling movie trailer. Our team was faced with the challenge of not only teaching a system to understand, “what is scary”, but then to create a trailer that would be considered “frightening and suspenseful” by a majority of viewers.

As with any AI system, the first step was training it to understand a subject area. Using machine learning techniques and experimental Watson APIs, our Research team trained a system on the trailers of 100 horror movies by segmenting out each scene from the trailers. Once each trailer was segmented into “moments”, the system completed the following;

1)   A visual analysis and identification of the people, objects and scenery. Each scene was tagged with an emotion from a broad bank of 24 different emotions and labels from across 22,000 scene categories, such as eerie, frightening and loving;

2)   An audio analysis of the ambient sounds (such as the character’s tone of voice and the musical score), to understand the sentiments associated with each of those scenes;

3)   An analysis of each scene’s composition (such the location of the shot, the image framing and the lighting), to categorize the types of locations and shots that traditionally make up suspense/horror movie trailers.

The analysis was performed on each area separately and in combination with each other using statistical approaches. The system now “understands” the types of scenes that categorically fit into the structure of a suspense/horror movie trailer.

Then, it was time for the real test. We fed the system the full-length feature film, “Morgan”. After the system “watched” the movie, it identified 10 moments that would be the best candidates for a trailer. In this case, these happened to reflect tender or suspenseful moments. If we were working with a different movie, perhaps “The Omen”, it might have selected different types of scenes. If we were working with a comedy, it would have a different set of parameters to select different types of moments.

It’s important to note that there is no “ground truth” with creative projects like this one. Neither our team, or the Fox team, knew exactly what we were looking for before we started the process. Based on our training and testing of the system, we knew that tender and suspenseful scenes would be short-listed, but we didn’t know which ones the system would pick to create a complete trailer. As most creative projects go, we thought, “we’ll know it when we see it.”

Our system could select the moments, but it’s not an editor. We partnered with a resident IBM filmmaker to arrange and edit each of the moments together into a comprehensive trailer. You’ll see his expertise in the addition of black title cards, the musical overlay and the order of moments in the trailer.

Not surprisingly, our system chose some moments in the movie that were not included in other “Morgan” trailers. The system allowed us to look at moments in the movie in different ways –moments that might not have traditionally made the cut, were now short-listed as candidates. On the other hand, when we reviewed all the scenes that our system selected, one didn’t seem to fit with the bigger story we were trying to tell –so we decided not to use it. Even Watson sometimes ends up with footage on the cutting room floor!

Traditionally, creating a movie trailer is a labor-intensive, completely manual process. Teams have to sort through hours of footage and manually select each and every potential candidate moment. This process is expensive and time consuming –taking anywhere between 10 and 30 days to complete.

From a 90-minute movie, our system provided our filmmaker a total of six minutes of footage. From the moment our system watched “Morgan” for the first time, to the moment our filmmaker finished the final editing, the entire process took about 24 hours.

Reducing the time of a process from weeks to hours –that is the true power of AI.

The combination of machine intelligence and human expertise is a powerful one. This research investigation is simply the first of many into what we hope will be a promising area of machine and human creativity. We don’t have the only solution for this challenge, but we’re excited about pushing the possibilities of how AI can augment the expertise and creativity of individuals.

AI is being put to work across a variety of industries; helping scientists discover promising treatment pathways to fight diseases or helping law experts discover connections between cases. Film making is just one more example of how cognitive computing systems can help people make new discoveries.

IBM Power Technical Briefing

Posted on

Evolving Solutions and IBM are proud to present an in-depth technical briefing featuring IBM Power on Thursday, November 9th.  Our briefing will include the latest updates and further details on how you can leverage the capabilities that IBM Power Systems has to offer.  The IBM and Evolving Solutions experts will be available to answer your questions and help your team decide what your needs and requirements are for IBM Power solutions.

Following the briefing, join us for happy hour and networking at Kip’s Irish Pub.

Some of the topics covered in this session will include:
  • POWER9 Architecture & Roadmaps
  • HMC Management & NovaLink
  • SR-IOV & vNIC
  • Nutanix on POWER
  • SAP HANA Linux on POWER
  • OpenSource DB on POWER
  • Tooling for POWER (PowerVC, PowerSC, VIOS Performance Monitoring, etc,)
Who should attend?
  • DB Administrators: Linux, Analytics, and Big Data
  • Administrators and Architects: Cloud, Web Application
  • Architects: Big Data and Analytics, Consolidation, Deployment, Enterprise, IT, Software, Virtualization
  • Managers: Data Center, IT, IT Operations, Project, Procurement, Program, Data Center


7:45 – 8:30 AM Registration & Breakfast
8:30 – 11:30 AM
Briefing Session
12:00 – 1:00 PM
1:00 – 4:00 PM
Continue Briefing Session
4:00 – 4:30 PM
Final Q&A Session
4:30 – 6:00PM
Networking & Happy Hour

To register your attendance please continue to event page:

Cognitive Computing: Improving X-Rays

Posted on

“What if your X-ray could predict a potential disease months in advance,” writes Laura Lorenzetti for Fortune. This past summer IBM Watson Health created a new partnership with leading medical providers and imaging tech companies to see if cognitive computing can take medical imaging one step further to actually predict the chance of diseases like cancer and heart failure.

Ms. Lorenzetti’s article points out that much of the data gathered from an x-ray or MRI is “unstructured.” It can be difficult for computers to connect the information to patient records in a meaningful way. IBM Watson Health is trying to change that and utilizing its power to connect unstructured data with its massive databases of patient medical history.  Ms. Lorenzetti writes, “the goal is to provide new offerings across various medical environments (a hospital ER or an everyday physician’s office) that can connect systems (medical records, picture archiving, lab results) and deliver cognitive insights to doctors on the spot for better diagnoses.”

One example from the article is the use of mammograms. Not only could Watson connect the image results to the patient’s medical history but it could also “cross-reference against the similar patients within the Watson database.”  These connections could improve a doctor’s  ability to identify early warning signs or risks.

Another example is the use of cognitive computing to help doctors predict which patients are more likely to have a heart attack after reporting chest pain.  Ms. Lorenzetti reports that 2% of patients who visit an ER with chest pain have the early signs of a heart attack missed. By connecting the data dots IBM Watson Health could help doctors identify these signs better.

IBM Watson Health’s shear power to process unstructured data such as medical imaging while also consuming vast amounts of patient data allows for it to draw cognitive insights that will one day improve patient diagnoses and treatments.

AI – Practical Applications

Posted on

Last week’s blog post featured information on what augmented intelligence (AI) means and the industries using the technology from IBM Research.  Today, let’s review a couple real life examples of AI applications.

First, a quick definition, IBM prefers to refer to AI as augmented intelligence.  Their approach is to use cognitive computing capabilities, such as machine learning, reasoning and decision tech, language, speech and visual tech and human interface tech, to create practical applications that enhance and scale human expertise.

IBM’s Watson Health – Partnering with New York’s Memorial Sloan Kettering Cancer Center (MSK), IBM’s application helps to consume and process the massive amounts of medical research while also “learning” from cancer experts, working to ultimately expand access to cancer treatment options and expertise. Laura Lorenzetti of Fortune explains, “Some MSK oncologists have a highly specific expertise in certain cancers. By training Watson to think like they do, that knowledge expands from one specialist to any doctor who is querying Watson. That means that a patient can get the same top-tier care as if they traveled directly to the center’s offices in Manhattan. IBM’s Watson provides the framework to learn, connect, and store the data, while MSK is imparting its knowledge to train the computer.”

Financial Services – cognitive computing is assisting financial advisors so  they can better serve their  clients.  By ingesting financial information and client data, Watson can answer the everyday client questions while also using its processing power to help identify potential options for the advisor to evaluate.  Many believe that by integrating with Watson financial advisors will be able to expand their practices and serve more clients. William Sprouse of Financial Planning further explains, “In practice, such cognitive computing power would work with an adviser just like a helpful Star Wars droid: virtually present during a meeting with a client, gathering data, and ready to instantly assist with queries and projections, along with its own suggestions based on client data.”

These two examples both demonstrate not only the processing power of augmented intelligence systems like Watson but also the ability to “learn”.  This ability to learn can provide access to critical expertise to more people than ever before in healthcare and financial services.

IBM: AI 101

Posted on

A recent article from Tech Crunch by Devin Coldewey highlights an RFI response from IBM regarding artificial intelligence (AI). Mr. Coldewey writes, “The field of artificial intelligence is so huge, and the potential applications so numerous, that it would be folly to try to explain it all in one — no, wait, IBM just did.” Today we will look at some of the highlights from IBM’s response.

First, artificial intelligence vs. augmented intelligence. IBM prefers to speak to augmented intelligence which is the process of creating systems that enhance and scale human expertise rather than systems that attempt to replicate human intelligence.  IBM further describes their approach as cognitive computing or “a comprehensive set of capabilities based on technologies such as machine learning, reasoning and decision technologies; language, speech and vision technologies; human interface technologies; distributed and high-performance computing; and new computing architectures and devices. When purposefully integrated, these capabilities are designed to solve a wide range of practical problems, boost productivity, and foster new discoveries across many industries.”

How is AI currently being used?  IBM provides the follow highlights by industry:

  • Healthcare – AI is advancing precision medicine through its ability to “ingest” patient information and run it against vast stores of medical research
  • Social Services – AI can be used to predict resource needs from specific population groups
  • Education – AI provides new capabilities to design true personalized learning plans
  • Financial Services – AI is being used to ensure financial resources are utilized well. This can come from the advancement of the applicant approval process or through efficient weighing and processing of insurance needs against risk, costs and regulations

In particular for IBM what started as a contestant on Jeopardy, IBM Watson, is now full blown cognitive computing that can be applied to practical problems in a variety of industries.

Next week, we will feature more on the blog from IBM’s AI 101. Be sure to check back. Until then you can also read more on AI and cognitive computing here.

It’s Here: IBMi 7.3

Posted on

“From the web interface used to order a birthday gift to the mobile interface used for paying bills, companies need modern capabilities like cloud solutions and deeper analytics to run their businesses in a secure environment,” writes Alison Butterill for IBM System’s In the Making blog.  Companies across all industries have a long history of turning to IBM i on Power Systems to meet their needs.

And just last week, IBM announced the release of IBMi  7.3.  Ms. Butterill reports the new release will allow you to better:

  • Conduct accurate analysis of data within a specific historical time period and provide an outlet to compare the insights against current data with DB2 for i temporal support.
  • Analyze data to plan ahead and build new strategies that improve business operations with newly enhanced OLAP functionality.
  • Optimize system management and security with the security authority collection.


IBM i 7.3Chief Architect for IBM i operating systems, Steve Will, also discusses the IBMi  7.3 release for IBM Systems Magazine. In his article, he writes the new release will have features that simplify insight, provide intelligent security and bring new open source options to developers.  Mr. Will provides several links to bloggers who dig deeper into each aspect of the new release. Here are the articles of note:

  • For more on IBMi 7.3 DB2 enhancements such as temporal support and OLAP functions, check out Mike Cain’s post on DB2fori blog.
  • Dawn May on IBM Systems Magazine dives into the security enhancements for 7.3, specifically the Authority Collection feature
  • IBM Business Architect for Application Development, Tim Rowe, takes a developer’s look at new integration with open source on System i Developers blog

Are you interested in talking specifically about what IBMi 7.3 can bring to your business? Contact our team at Evolving Solutions.

Industry News Round- up – Watson in the News

Posted on

IBM Watson
The IBM Watson-powered concierge “Connie” at work in a hotel (
IBM’s Watson continues to be a top news story and industries are finding creative uses for Watson’s abilities.  Today let’s look at what Watson has been up to in retail, entertainment and hospitality.

Watson and MasterCard Partner to Bring Big Data to Small Business

According to ZDNet, MasterCard has integrated IBM Watson into its platform to give small and medium-sized merchants access to big data analytics.  Soon merchants will be able to access real-time, analytics based market insights on revenue, market share and customer types.  MasterCard recognized that their small business customers may have data but they lack the resources to gain real insights.  Watson in particular will be able to deliver more views into customer behavior and buying trends. What they are labeling as “smarter data” will become more accessible and actionable through this new partnership.

Watson at Hogwarts

A little pop culture, according to Tech Insider Watson analyzed the Harry Potter books and movies using the “Big Five” test to assess personality traits to classify characters and to compare how their roles changed from the books to on film.  One finding ranked Harry high for anger second only to Voldemort despite being the “good guy.” Watson also agreed with many Harry Potter fans that Ginny’s character in the movie is not as strong as in the books, noting she ranked higher for intellect and gregariousness in the books. Finally, Professor McGonagall was the character left most intact when comparing the books to the movies.

Watson Works as Hotel Concierge

Have you heard about Connie the robot concierge?  PC Magazine reports Hilton has partnered with IBM to use its Watson-powered robot to act as hotel concierge, recommending restaurants, attractions and hotel amenities to guests. Connie uses Watson speech and language APIs to interact with guests and respond to questions. The more Connie interacts the more she “learns” and the more the technology improves.

Industry News Round- up – What is Watson Up To?

Posted on

With a new year upon us, today let’s look at what IBM Watson has been up to so far in 2016.

More Work for Watson

Fortune recaps Watson at CES where IBM announced new ways in which Watson is being used. Stacey Higginbotham writes, “Watson now offers coaching through Under Armour’s app for consumers using certain products. Watson can also warn diabetics using certain Medtronic devices if their blood sugar gets too low. Whirlpool is using the cognitive computer to grab data from its connected appliances in hopes of understanding if there are flaws in its manufacturing lines. And finally, Watson is now the brains inside SoftBank’s Pepper robot.”  Ms. Higginbotham points out Watson’s ever expanding capabilities – voice recognition, computer vision and predictive intelligence.

For Whirlpool using Watson is about handing data from connected appliances better and for Medtronic and SoftBank it is more about extracting more value and opportunities from existing data.  All in all, more industries are finding work for Watson.

Watson-powered Wellness App

Natalie Gagliordi of ZDNet reports, “IBM’s Watson-powered wellness app with Pathway Genomics enters alpha release.The app focuses on a wellness report compiled from a bevy of data sources, such as a user’s genetic test, health habits, and health tracker information from the likes of Apple HealthKit.”  This new app crunches diet, exercise and metabolism to build a “personalized approach to preventative medicine.” Ms. Galiordi points out that this is the latest effort by IBM to position Watson at the forefront of medical innovation.

Watson Takes on the World

Bernard Marr takes a step back on Thoughts on Cloud and digs into what makes Watson tick. In his interview with IBM, he describes the three “legs” that form Watson’s cognitive computing. First, Watson is designed to use natural language processing so it can work and react in real language and IBM points out it can even learn nuances, idiosyncrasies and colloquialisms of human language. Second, Watson can process enormous amounts of data to come up with probabilistic answers. And finally Watson’s ability to learn, fueled by big data Mr. Marr points out, means Watson can only get better with every use.

Watson & IoT in 2016

Posted on

Chris O’Connor of IBM titles his latest article “Reimagining the future with the cognitive Internet of Things (IoT).” In the article he talks about how bringing IBM Watson into the world of IoT will allow businesses to better harness the data and extract insights.  He writes, “Despite the great strides we have seen in IoT technology and applications, the Internet of Things has much room for growth. Much of the dark data and edge data created by the Internet of Things holds great value—if it can be deciphered and put to use.”  Businesses feel overwhelmed by the thought of putting into place systems that can unlock the insights of IoT data but perhaps a little “reimagining” as Mr. O’Connor puts it is just what is needed.

His solution for IoT, cognitive computing, “To bring ambitious IoT applications into being, we need powerful, sophisticated ways of processing an increasingly large and varied flow of IoT data. In short, we need the Internet of Things to be smarter than it is, and we need to get ever more value from the data it produces. Using cognitive computing systems that learn at scale, reason purposefully and interact naturally with humans, we can begin exploiting IoT data to an unprecedented degree.” Enter IBM Watson.

Again Watson pops up in another place and another use as we close out 2015. It certainly has come a long way since Jeopardy. IBM applies Watson’s capabilities to IoT and will offer a number of application programming interfaces (APIs) to help businesses manage ever increasing data loads. APIs will include:

  • Natural Language Processsing
  • Machine Learning
  • Video and Image Analytics
  • Text Analytics

Mr. O’Connor closes, “Watson Internet of Things gives enterprises a way to tap into the flood of IoT data, then use that data to answer previously unasked questions and make intelligent business decisions.”

IBM Reflects on Cloud in 2015

Posted on

IBM Thoughts on Cloud recently conducted a Twitter chat to gather opinions on the biggest stories and developments in 2015 around cloud, mobile and the Internet of Things (IoT).  Kevin Allen summarizes the lead cloud findings below:


Many on the Twitter chat felt that “containers are here to stay.” As 2015 has progressed more enterprises are using them. Mr Allen describes the adoption as “ubiquitous” and IBM Fellow Jason McGee says, “Containers are everywhere. They are dominating the current landscape and are changing the way we think about how apps are deployed.”

Hybrid Cloud

Mr. Allen writes, “It seems like every year for the past few years someone has declared it The Year of Hybrid Cloud. But are we really there? Has a hybrid approach become the norm? Are we well past The Year of Hybrid Cloud, or is it yet to come?” Opinions are mixed; some feel cloud has grown so fast and covers so many solutions that it doesn’t make sense to declare a year for any one part of the technology and others feel the groundwork is now laid to bring hybrid to more enterprises and that hybrid is a key cloud trend.

Data Security

Again Jason McGee is quoted in Mr. Allen’s article, “Interestingly, most of the high profile security breaches involved internal non-cloud IT problems. Enterprises are starting look to cloud to help with security given the rigorous processes and standardized environments.” In 2015 cloud has turned from a data security concern to a solution for better data security.

Open Source

2015 set the stage for the key “elements” of open cloud architecture. From Open Stack to the Cloud Native Computing Foundation to Swift the foundations have been laid  and IBM expects that in 2016 it will all come together to form a “consistent programing and operating model.”


If you are a developer yourself you are probably already feeling the change, but IBM points out that developers are becoming more responsible for the entire life cycle.  The job has changed from writing code to also understanding cloud and being part of the larger development and evolution of an application.

It is an interesting Twitter chat on 2015 and cloud trends to watch. You can check it out in full here. Share your own thoughts on how cloud has evolved in your organization this year.