IEEE 5th World Forum on Internet of Things
15-18 April 2019 – Limerick, Ireland

TOP1-Artificial Intelligence

Date: Tuesday, 16 April 2019
Time: 11:00-18:30
Room: C1060

Track Description

Insights from data are essential to many IoT applications. Digitization and exploitation of data in products, services, and processes makes it possible to find important patterns and to perform complex analysis and optimization through computation. Artificial Intelligence approaches are revolutionizing the potential of the depths and value for these insights, as well as the scale at which the benefits can be derived automatically.

The approaches enable new and more powerful, time-series analysis; audio, image, and video analytics; and they open the way for self-learning controls and contextual reasoning to derive actionable insights. In combination with novel speech and gesture based user interfaces, AI can support users in a new, natural way in performing their tasks. The compact form of IoT devices and the added value of AI enable both novel applications and business models. This all makes Artificial Intelligence a quickly evolving area in IoT-related research and in industrial applications.

Within the session we will discuss the potential of novel technologies as well as feasible applications of AI for IoT use cases and the experiences from actual deployments.

The session will investigate topics on:

  • Automated Machine Learning
  • Machine Learning on the Edge
  • Semantic modeling and context learning
  • Deep Learning for Control
  • Constraint Optimization
  • Ethics and Applications



11:00-13:00 Session 1, Deploying AI for IOT
Talk 1 “Artificial Intelligence Supporting Interoperability in the Internet of Things”, Dirk Pesch, University College Cork, Ireland
Talk 2 “How AI Can Orchestrate IoT Devices in Industry 4.0”, Alexander Fay, Helmut-Schmidt-University in Hamburg, Germany
Talk 3 “Industrial AI – From Prediction to Prescription”, Shiva Sander-Tavallaey, ABB, Sweden
Panel Discussion

13:00-14:00 Lunch

14:00-16:00 Session 2, AI and IOT: Sensing and Augmented Reality
Talk 4 “The Next Generation Human-Machine Interface in Medical Applications”, Per Nohlert, M.Sc., VP Products, Neonode Inc.
Talk 5 “Smart Sensing in the IoT Era: Machine Learning on Ultra Low Power Microcontrollers”, Michele Magno, ETH Zürich, Switzerland
Talk 6 “Augmented Reality, Cyber-Physical Systems, and Feedback Control for Additive Manufacturing”, Hugo Lhachemi, UCD, Ireland
Panel Discussion

16:00-16:30 Coffee Break

16:30-18:00 Session 3, AI and IOT in Public Contexts
Talk 7 “AI on the Edge for Computer Vision Applications in Smart Cities”, Noel O’Connor, Dublin City University, Ireland
Talk 8 “AI, IoT and Public Safety”, Ken Brown, University College Cork, Ireland
Wrap-up and Summary


Track Co-Chairs

Joern Ploennigs, IBM

Joern PloennigsDr.-Ing. Joern Ploennigs is scientific researcher and manager at IBM Research – Ireland. He works on several aspects of enriching IoT by cognitive computing including machine learning, semantic reasoning, and natural interfaces to enable autonomous, highly scalable, and accessible IoT solutions for a sustainable future. Prior to joining IBM, he was heading the junior research group at Technische Universitaet Dresden, Germany, as well as the data analytics group in the Irish strategic research cluster ITOBO as Feodor-Lynen fellow of the Humboldt-Foundation. He holds a master in electrical engineering for automation and control and a PhD in computer science from Technische Universitaet Dresden. He is chair of the IEEE IES TC BACM and board member of the IEEE IoT initiative as well as program committee member of several renowned international conferences and journals.

Barry O’Sullivan, University College Cork

Barry O'Sullivan

Professor Barry O’Sullivan is an award-winning academic working in the field of artificial intelligence, data analytics, AI and data ethics, constraint programming, and operations research, for more than two decades. He holds the Chair of Constraint Programming in the Department of Computer Science at University College Cork. He served as Head of Department, Computer Science, from 2012-2015. He is the founding Director of the Insight Centre for Data Analytics at UCC, and a Principal Investigator at the Confirm Centre for Smart Manufacturing which is based at the University of Limerick. He is an Adjunct Professor at Monash University, Melbourne, Australia.

Professor O’Sullivan is a Fellow and current Deputy President of the European Artificial Intelligence Association (EurAI), one of the world’s largest AI associations with over 4500 members in over 30 countries. Professor O’Sullivan was President of the International Association for Constraint Programming from 2007-2012. In 2013 he received a UCC Leadership Award and won the Association for Constraint Programming Distinguished Service Award in 2014. He was named Science Foundation Ireland Researcher of the Year for 2016, UCC Researcher of the Year in 2017, and elected to membership of the Royal Irish Academy in 2017, Ireland’s highest academic accolade.

Professor O’Sullivan has been involved in winning over €200 million in research funding, of which approximately €30 million has directly supported his research activities at UCC. He runs his own AI consulting firm, AI Machina, and welcomes opportunities to engage in projects with governments, multi-nationals, public bodies, and SMEs, alike.

Track Speakers

Ken Brown

Ken BrownKen Brown is a Professor in the School of Computer Science and Information Technology at University College Cork in Cork, Ireland. Ken’s research focuses on applications of artificial intelligence, with a particular interest on applications in wireless networking and IoT in the built environment. He has over 30years research and development experience. He is a PI on Insight (centre for data analytics), a funded investigator on Confirm (smart manufacturing) and Connect (future networks), and an executive committee member of Enable (smart cities and communities). He is a PI on the EU ECSEL project SCOTT, on Secure Connected Trustable Things.

Talk Title: AI, IoT and Public Safety

Alexander Fay

Alexander FayAlexander Fay (IEEE Member’02, Senior Member ’07) received the Diploma with honors and the Ph.D. with honors in electrical engineering from the Technical University of Braunschweig, Germany, in 1995 and 1999, respectively. He worked five years at the ABB Corporate Research laboratories in Heidelberg and Ladenburg in the position of Head of Mechatronics research group and Head of Engineering Methods research group, among others. Since 2004, he is Full Professor and Head of the Institute of Automation Technology at the Helmut-Schmidt-University in Hamburg, Germany.

In 2002, he was awarded one of “World’s Top 100 Innovators under 35” by MIT Technology Review. Alexander Fay received the Ring of Honor of the Association of German Engineers (VDI) in 2009.
He is member of the scientific advisory board of the German Society for Measurement and Automation (GMA) and Head of its Engineering and Operation of automated Facilities department. He was a member of the IEEE Industrial Electronics Society Administration Committee 2009-2011. Since 2009, he serves as an Associate Editor of IEEE Transactions on Industrial Informatics.

He is author of more than 100 reviewed national and international journal papers and of more than 150 reviewed national and international conference papers, and of 7 patents. Currently, he has 20 researchers at his institute and is supervisor of about 20 Ph.D. theses. Between 2011 and 2013, he served as the Dean of the Mechanical Engineering Faculty, and between 2013 and 2015 as the Dean of the Industrial Engineering Department of his university.

Since 2014, he is member of the Scientific Advisory Board and of the WG 2 “Research and Innovation” of the German „Industrie 4.0“ initiative..

His main research interests are models and methods for the engineering of large automated systems, especially in the process and manufacturing industries, in buildings and transportation systems. Among other methods, he develops and employs knowledge-based methods, ontologies and other AI techniques. The aim of his team is to develop models, methods and tools to increase engineering efficiency and to assist in the engineering and operation of industrial plants. The research projects are mostly undertaken in close cooperation with industry, i.e. suppliers and/or users of automation technology. Current research topics are, among others

  • agent based control of transportation systems (e.g. railway freight transport, baggage transport in airports, and work piece transport within production systems)
  • requirement engineering for production systems regarding flexibility, agility, robustness etc.
  • development of a reference framework for evaluating and comparing agent-based control algorithms in comparison to other decentralised and central control algorithms under varying degrees of disturbances
  • stability analysis of decentralised decision-making entities with time-delayed feedback
  • market-based multi-agent system for decentralized power and grid control
  • automatic code generation based on GRAFCET specifications
  • simulation-based virtual commissioning of production automation systems,
  • knowledge-based automation of engineering tasks,
  • automated reduction of alarm floods,
  • methods for the systematic modernization of automation systems and adaption to “Industry 4.0” needs.
  • robot-based manufacturing of lot-size-1-workpieces,
  • real-time location and location-based services.

Talk Title: How AI Can Orchestrate IoT Devices in Industry 4.0

The term “Industry 4.0” (or “Industrie 4.0” in German) refers to the fourth industrial revolution, a change in the organisation and management of the entire value chain throughout products’ life cycles due to increased and ubiquitous information and communication technology. Industry 4.0 relies on all the relevant information being made available in real time through networking of all the different components that make up the value chain, as well as the ability to use this data to ascertain the optimal value stream at any given point in time. This networking of human beings, objects and systems enables the emergence of dynamic, real-time optimised and self-organising value chains involving several different companies and providing new business models. These value chains can be optimised based on a variety of criteria such as cost, availability and resource consumption.

The core technologies of Industry 4.0 are IoT on the one hand, as machines, transport systems and even work pieces are equipped with sensors and communication means, and AI on the other hand, as industrial production and transport need to be controlled in a decentral way, where software agents, semantic technologies, and other facets of AI turn out to be helpful.

To structure the field of Industry 4.0, the German Industrie 4.0 Initiative has developed a dozen “Application Scenarios”, covering products, processes and production resources, from engineering to operation. These Application Scenarios help to structure existing and future use cases and application examples. Furthermore, they give guidance towards the need for AI technologies, both regarding functional and non-functional requirements.

Within this talk, the requirements and the successful application of AI technologies in selected Industry 4.0 Application Scenarios will be discussed, putting emphasis on how AI is employed to implement the ideas of IoT in the production and logistics domain.

The author is a member of the Working Group 2 of the German Industrie 4.0 initiative, which has elaborated these Application Scenarios and developed a research roadmap from this endeavor. Currently, the Application Scenarios are matched with similar approaches on an international level, e.g. with Italy, France, and Japan.

Hugo Lhachemi

imageholder-150x190Talk Title: Augmented Reality, Cyber-Physical Systems, and Feedback Control for Additive Manufacturing

Michele Magno

Michele MagnoMichele Magno is currently a Senior Researcher and lecturer at ETH Zürich, Switzerland at the Department of Information Technology and Electrical Engineering (D-ITET) . He received his master and Ph.D. degrees in electronic engineering from the University of Bologna, Italy, in 2004 and 2010, respectively. He was postdoctoral research at Tyndall Institute, Ireland and University College Cork, Ireland, and a visiting professor at University of Nice and ENSSAT University of Rennes, France. His current research interests include smart sensing, low power machine learning, wireless sensor networks, wearable devices, energy harvesting, low power management techniques, and extension of the lifetime of batteries-operating devices. He has authored more than 140 papers in international journals and conferences. Some of  his publications were awarded as best papers in IEEE conferences such as IEEE International Conference on E-health Networking, Application & Services 2018, IEEE Sensors Applications Symposium (SAS) 2018, IEEE International Workshop on Advances in Sensors and Interfaces 2017 among others.  He is a senior IEEE member and an ACM member.

Talk Title: Smart Sensing in the IoT Era: Machine Learning on Ultra Low Power Microcontrollers

Machine Learning (ML) and artificial intelligence are pervading the digital society. Today, even low power embedded systems are incorporating ML, becoming increasingly “smart.” This talk gives an overview of ML methods and algorithms to process and extract useful near-sensor information in end-nodes of the “internet-of-things”, using low-power microcontrollers ARMCortex-M; Bluetooth low energy SoC, and other low power microcontrollers. The main objective is to show how Machine Learning algorithms can be adapted to the performance constraints and limited resources of low-power microcontrollers. Finally, the talk will introduce an open source library based on Fast Artificial neural network, that allows easily to implement Artificial Neural Network on ARM Cortex-M Family.

Per Nohlert

Per NohlertMr. Nohlert holds a Master of Science Degree in Industrial Engineering and Management from Linköping University, Sweden. Prior to joining Neonode, Mr Nohlert worked in the Aerospace and Marine industry at Rolls-Royce in different roles within product management, business development and manufacturing engineering. Mr. Nohlert is responsible for Neonode’s product portfolio – setting the strategy, technology roadmap and product specifications to ensure the company’s short- and long term relevance and competitive edge.

Talk Title: The Next Generation Human-Machine Interface in Medical Applications

Introduction to Neonode as a key player in creating the next generation’s HMI solutions for the medical industry. Neonode’s optical sensing technology is deployed in more than 67 million products around the globe, including 4 million cars and 63 million consumer devices. The strong legacy combined with many years of extensive R&D and a strong innovative spirit have resulted in the company’s latest sensor platform – zForce AIR – which is an extremely versatile and powerful platform ideal for many HMI applications in multiple industries. With the new sensor platform, Neonode has recognized great interest from the medical industry as it can solve quite some problems that haven’t been possible to solve in the past. Why the technology is disruptive for the medical industry will be explained and some hands-on explanations of various medical use cases and application concepts will be covered.

Noel O’Connor

Noel O'ConnorProf. Noel E. O’Connor is a Full Professor in the School of Electronic Engineering at Dublin City University (DCU) Ireland. He is a Director of the Insight Centre for Data Analytics, Ireland’s largest SFI-funded research centre. He was previously Academic Director of DCU’s Research and Enterprise Hub on Information Technology and the Digital Society, with the responsibility of coordinating multi-disciplinary ICT-related research across the university. The focus of his research is in multimedia content analysis, computer vision, machine learning, information fusion and multi-modal analysis for applications in security/safety, autonomous vehicles, medical imaging, IoT and smart cities, multimedia content-based retrieval, and environmental monitoring. Since 1999 he has published over 400 peer-reviewed publications, made 11 standards submissions, and filed 7 patents. He is an Area Editor for Signal Processing: Image Communication (Elsevier) and an Associate Editor for the Journal of Image and Video Processing (Springer). He is a member of the ACM and IEEE.

Talk Title: AI on the Edge for Computer Vision Applications in Smart Cities

Dirk Pesch

Dirk PeschDirk Pesch is a Professor in the School of Computer Science and Information Technology at University College Cork in Cork, Ireland. Dirk’s research interests focus on architecture, design, algorithms, and performance evaluation of low power, dense and moving wireless/mobile networks and services for Internet of Things and Cyber-Physical System’s applications and interoperability issues associated with IoT applications. He has over 25 years research and development experience in both industry and academia and has (co-)authored over 200 scientific articles. He is involved in a number of Irish national collaborative research centres, the CONNECT Centre for Future Networks and the CONFIRM Centre for Smart Manufacturing. He has also been active in many EU funded research projects, having coordinated the FP7 SCUBA and GENiC projects focused on smart building and data centre energy efficiency. Dirk is on the editorial board of Springer’s Wireless Networks and the International Journal of Distributed Sensor Networks and contributes to international conference organization in his area of expertise. He is a senior member of the IEEE and a member of the ACM. Dirk received a Dipl.Ing. degree from RWTH Aachen University, Germany, and a PhD from the University of Strathclyde, Glasgow, Scotland, both in Electrical & Electronic Engineering.

Talk Title: Artificial Intelligence Supporting Interoperability in the Internet of Things

Shiva Sander-Tavallaey

Shiva Sander-TavallaeyShiva Sander Tavallaey received a MSc in Mechanical Engineering 1988 from Chalmers University of Technology (CTH) and a PhD in Sound and Vibration/ Technical Acoustics in 2000 from Royal Institute of Technology (KTH), Sweden. After graduating as MSc, she started at Volvo Car AB as Senior designer, where she among the others initiated an R&D project in collaboration with Royal Institute of Technology (KTH) which in turn lead to her increased interest in the field of wave propagation in different media as well as signal processing. In January 2001 she joined ABB Corporate Research in Västerås, Sweden. After a specialist career within condition monitoring and diagnostics, culminating in an appointment to Principal Scientist in 2009, she started in a management position leading a team of 15-20 specialists in modeling and control of industrial automation applications. During this period, she continued working with different applications and projects applying state of the art approaches such as AI/ ML for anomaly detection, predictive and prescriptive maintenance. In 2015, she was appointed as Adjunct professor at Royal Institute of Technology (KTH) in the department of Vehicle Engineering, at Marcus Wallenberg Laboratory of sound and vibration. In February 2018 she stepped off the management team to follow the specialist career. She was appointed in May 2018 as Senior Principal Scientist in Applied Analytics. She is since March 2018 appointed as AI-Lead in Sweden coordinating the AI-related activities in ABB Sweden.

Talk Title: Industrial AI – From Prediction to Prescription

Industrial automation has progressed for more than one century. A factory/ an industrial plant is traditionally a physical location where things are made, row material evolves, and value is created, but the digitization of industry is transforming it into something much more: A collection of skills, abilities, and systems that get smarter over time, thereby enabling businesses to innovate what, how, who, and where manufacturing gets done. The automation systems, typically performing precisely defined instructions within a limited scope of operation, will now act “autonomously “[1] on a more complex level, encompassing also what is not known or foreseen. This requires that the automation system should have an overall approach covering the whole product lifecycle including supply chain as well as maintenance and after sales. This transition will unlock greater value by improving productivity and increasing efficiency.

The shift to Autonomous systems will happen over a period of time. The current automation systems will evolve and integrate more AI accompanying with exiting basic functionality (e.g. safety). Industrial AI has some requirements that are not fulfilled by today “mainstream” AI, such as durability and robustness. AI and automation need to seamlessly work together. As new AI techniques develop, more and more elements in product lifecycle will benefit by the progress. Service and maintenance have already been exploited and today we see great value created in service and maintenance. Having access to data, of rather high quality, not only indicating the traditional condition monitoring signals such as vibration and oil debris but also synchronized operational data, provide possibility to not only predict the estimated remaining useful life of the assets but also closing the loop and prolong the assets lifetime by modifying and optimizing the operational condition accordingly.

In this talk starting from describing the underlying drivers towards utilization of more advanced data-driven approaches such as AI/ML in industrial application we will present a particular example where a combination of domain knowledge and data-driven approaches can literarily prolong a critical asset’s remaining useful life.

[1]- David P. Watson and David H. Scheidt, Autonomous Systems, Johns Hopkins APL Technical Digest, Volume 26, Number 4, p. 368-376 (2005).

Robert Shorten

Robert ShortenProfessor of Control Engineering and Decision Science
School of Electrical and Electronic Engineering
University College Dublin

Prof. Robert Shorten graduated from UCD with a B.E. degree in EE in 1990 and a Ph.D. degree in 1996. Since then, he have worked in academia and industry and will continue to split time between both.

In industry, he has been employed by both Daimler-Benz Research and IBM Research, where he led the Control/Optimization activities at IBM Research Ireland in the area of Smart Cities, as well as being a consultant to industry.

Highlights of Robert’s academic activities include time as a Professor at the Hamilton Institute, where he was a co-founder of the Hamilton; spending time as a Visiting Professor at TU Berlin in 2011-12, and a very formative period working with Professor Narendraat Yale University.

Robert is currently a Professor of Control Engineering and Decision Science at UCD and continues to act as a consultant to IBM Research.