Complex control problems arise in the operation of critical infrastructure, including electricity, gas, water and transportation. This project is developing ‘rangl’, an AI competition environment for practitioners (both novice and experienced) to apply classical and machine learning techniques and expert knowledge to UK-centric problems. The project will work with industrial challenge holders to develop insights into the leading classes of solution.
Explaining the science
Infrastructure systems, including electricity, gas, water and transportation, must operate reliably at acceptable cost in the context of ageing infrastructure and new technological possibilities. At the same time a greater amount of measurement and forecast data is becoming available. There is a growing need for appropriate AI controllers to leverage this data. Artificial intelligence, with its speed, scale and accuracy, offers transformative potential in applications to these problems. However, controllers for critical infrastructure should be robustly assessed in an appropriate simulation environment.
This project is developing a competition platform in which challenge environments are formulated in the reinforcement learning framework using the “agent-environment loop”. At each timestep the controller (agent) chooses an action based on the current observation, and the challenge environment returns a new observation and a reward. The aim is to create controllers with intelligent characteristics, capable of handling both quantifiable and unquantifiable uncertainty and encoding expert knowledge. Competition entrants document their controllers, helping to develop insights into the leading classes of solution.
'Rangl' is a competition platform created at The Alan Turing Institute as a new model of collaboration between academia and industry. Through integration with OpenAI Gym, rangl offers a user-friendly environment to develop learning approaches to data-driven control problems. Anybody can propose a rangl challenge, compete in a challenge by designing a controller, or contribute an ‘off-the-shelf’ AI controller for users to customise.
The platforms assess user-submitted algorithms for specific tasks, helping the best classes of solution to emerge; a proven mechanism for realising the potential of AI.
18–25 January 2021 – First RangL Challenge
From 18 to 25 January 2021 the RangL team fulfilled a long-held ambition: to run a generation scheduling challenge.
This ‘look-ahead mode’ generation scheduling was one of the first motivations for RangL, when the project was
The competition itself was heavily oversubscribed, with applicants from Argentina, Denmark, the Netherlands, Italy,
We recently argued on the Turing blog that as the world reopens following the pandemic, we will need to make more
21 June 2021 – Pathways to Net Zero project kick-off
The RangL competition platform exists to accelerate progress in data-driven control problems for industry, and today marks the real beginning of that journey.
The purpose of the Net Zero Technology Centre is to develop and deploy technology for an affordable net zero energy industry, and the Offshore Renewable Energy (ORE) Catapult is the UK’s leading technology innovation and research centre for offshore renewable energy.
Today, colleagues from the Net Zero Technology Centre, ORE Catapult and RangL team gathered to make a start on the Pathways to Net Zero challenge. The agenda was focused on first introducing the competition platform and then understanding the Net Zero Technology Centre / ORE Catapult Integrated Energy Vision (IEV) model, on which the challenge will be based.
The IEV is the result of a major modelling exercise undertaken collaboratively by the Net Zero Technology Centre and ORE Catapult, and addresses the UK's vision of achieving net zero carbon emissions by 2050 for the North Sea offshore energy industry. The range of possibilities is illustrated by three imagined pathways, Breeze, Gale and Storm, each addressing the four main technology pillars of offshore energy: offshore wind, oil and gas, hydrogen, and carbon capture and storage (CCS).
The Pathways to Net Zero challenge aims to build on the IEV by first allowing a range of intermediate pathways between Breeze, Gale and Storm, then defining a criterion to measure the quality of each pathway in a specific sense. Challenge participants will be invited to apply reinforcement learning, or any other approach of their choice, to find the ‘best’ pathway. The challenge will be made more realistic and difficult by the inclusion of uncertainty over future parameters such as energy revenues and technological progress.
1 July 2021 – Pathways to Net Zero RL environment
RangL aims at applying reinforcement learning (RL) to solve real-world industrial problems by involving participants from the wide AI community. Today, our focus was therefore on developing an appropriate RL environment for the Pathways to Net Zero challenge.
The objective is to find optimal deployments for technologies such as offshore wind, blue and green hydrogen, and carbon capture and storage. These technologies will be instrumental in reaching the UK’s target of net zero carbon by 2050.
After brainstorming we opted to take Breeze, Gale and Storm as baseline scenarios from which others can be built. An agent will interact with the RL environment by choosing a mix of those scenarios and also by varying the speed with which they are implemented. For instance, earlier deployment reduces lifetime emissions but generally implies higher capital costs. Solutions will also need to meet some non-monetary constraints, e.g. balancing job creation in new technologies against the loss of roles in decommissioned infrastructure. We will also work with the Net Zero Technology Centre and ORE to extend the Integrated Energy Vision appropriately, so that lifetime emissions and their social cost can be considered in the RL reward function.