Enabling Flexible Hydropower Operation by AI-Based Active Flow Control

PhD project on deep reinforcement learning for active flow control of hydraulic turbine instabilities

This page provides detailed information about the research project for prospective PhD applicants. See the job advertisement for application details.

Project summary

This project develops a novel AI-based active flow control strategy for mitigating harmful flow instabilities in hydraulic turbines operating under off-design conditions. By coupling Deep Reinforcement Learning (DRL) with high-fidelity Computational Fluid Dynamics (CFD), the project aims to create a feedback-driven control framework that stabilizes the flow across varying operating regimes, contributing to safer and more flexible hydropower operation in future energy systems.

Conceptual illustration of the AI-based active flow control framework for hydraulic turbines

Conceptual illustration of the project. An AI agent observes the flow in the turbine draft tube and learns to actively control the instability through jet actuation.

The project is funded by: ÅForsk Foundation, with co-funding from the Linköping University.
Principal investigator: Saeed Salehi, Linköping University
Co-supervisor: Håkan Nilsson, Chalmers University of Technology
The project is carried out as a collaboration between the Division of Applied Thermodynamics and Fluid Mechanics at Linköping University and the Division of Fluid Dynamics at Chalmers University of Technology.


Background and motivation

The increasing penetration of intermittent energy sources such as wind and solar power places greater demands on hydropower to operate more flexibly to balance the electric grid. This flexible operation involves frequent starts and stops, continuous regulation, and prolonged operation at off-design conditions. These operations are known to promote strong self-induced flow instabilities that generate harmful pressure pulsations (Salehi and Nilsson, 2021; Salehi and Nilsson, 2022), accelerate structural fatigue, reduce lifetime, and limit the safe operating range of hydraulic turbines (Nobilo et al., 2026).

Helical vortex rope instability in a Francis turbine draft tube during shutdown

Flow instability during shutdown operation of a Francis turbine, showing helical vortex rope structures in the draft tube (Salehi and Nilsson, 2021).

Several strategies have been proposed to mitigate flow instabilities in hydraulic turbines. Passive approaches rely on geometric modifications of the runner or draft tube to weaken instabilities or stabilize the flow. Active flow control techniques typically employ air admission or water injection supplied by external energy sources. Air admission redistributes low-pressure regions to damp pulsations, whereas water injection directly alters the angular momentum of the swirling flow.

Despite the progress in passive and active mitigation strategies, most reported approaches rely on predefined geometric modifications or actuation settings tailored to specific operating conditions, without adaptive feedback from the evolving flow field. While these strategies may reduce pressure fluctuations and their associated vibrations, their performance is limited to specific operating regimes and is sensitive to tuning. In addition, most active control strategies do not explicitly account for performance optimality; instability mitigation is often achieved at the expense of increased actuation energy or reduced turbine efficiency.

These limitations motivate the development of feedback-based control strategies that maintain effective instability mitigation across varying operating conditions while minimizing additional energy consumption and limiting turbine efficiency degradation. This is the main purpose of this project.


Approach

The high-dimensional and nonlinear dynamics of turbine instabilities limit the practical applicability of conventional model-based control methods. Deep Reinforcement Learning (DRL) offers an alternative by enabling systematic optimization of control policies directly from flow observations in complex dynamical systems. Recent advances in DRL have demonstrated the ability to construct feedback control policies for complex, nonlinear flow systems, including laminar (Rabault et al., 2019), weakly turbulent (Ren et al., 2021), and fully turbulent flows (Sonoda et al., 2023), though predominantly in simplified settings rather than realistic engineering systems.

In the proposed framework, a deep neural network (the agent) interacts with a high-fidelity CFD simulation in a closed loop: the agent observes the flow state, selects a control action (e.g., jet actuation), and receives a reward signal reflecting the degree of instability suppression. Through iterative training, the agent learns a control policy that adapts to the flow dynamics, without requiring an explicit mathematical model of the instability.

With DRL-based flow control reaching methodological maturity in canonical configurations, extending these approaches to practical engineering systems, particularly turbine-related instability problems, represents a natural and necessary next step.


Research foundation

The project builds on our established experience in high-fidelity simulation of hydraulic turbine flows and reinforcement learning-based flow control. Much of this groundwork was carried out while the PI was a researcher at Chalmers University of Technology, funded by the Swedish Centre for Sustainable Hydropower (SVC).

High-fidelity simulation of hydraulic turbines

We have long-standing experience in high-fidelity simulations of hydraulic turbines under steady, off-design, and transient operations. Previous work includes detailed numerical investigations of vortex rope dynamics, shutdown and start-up transients, and uncertainty quantification in Francis turbines, Kaplan turbines, pump-turbines, and swirl generator configurations. These efforts have resulted in numerous peer-reviewed publications (e.g., Salehi and Nilsson, 2021; Salehi and Nilsson, 2022; Salehi and Nilsson, 2023; Salehi and Nilsson, 2024; Masoodi et al., 2024a; Masoodi et al., 2024b). This extensive background provides validated numerical frameworks and a detailed understanding of swirl-induced flow instabilities and associated pressure pulsations.

DRL-CFD coupling framework

In parallel, we have developed a computational framework for coupling DRL with the CFD solver OpenFOAM (Salehi, 2025). The framework enables efficient closed-loop integration between learning algorithms and high-fidelity flow simulations and has been released as open-source software: TensorforceFoam on GitHub.

The methodology has been applied to active flow control problems. The figures below illustrate representative results, including successful control of vortex-dominated flow structures in both 2D and 3D configurations.

Comparison of uncontrolled and DRL-controlled flow past a 2D cylinder

Uncontrolled (left) and DRL-controlled (right) flow past a 2D cylinder (Salehi, 2025). The learned control policy suppresses the vortex shedding.

Uncontrolled vortex shedding behind a 3D cylinder

Uncontrolled 3D cylinder wake

DRL-controlled flow behind a 3D cylinder showing suppressed vortex shedding

DRL-controlled 3D cylinder wake

Proof-of-concept: DRL control of draft tube instability

As a first step toward the present project, we conducted a proof-of-concept study on a swirl generator configuration representing a simplified hydraulic turbine draft tube. A DRL controller was coupled to a 3D CFD model with localized axial jet actuation at the runner cone.

Uncontrolled helical vortex rope in the swirl generator draft tube

Uncontrolled vortex rope

Vortex rope significantly reduced under DRL-based closed-loop control

DRL-controlled vortex rope

Under closed-loop control, the strength of the helical flow instability is significantly reduced compared to the uncontrolled case. The corresponding time evolution of the rotating pressure mode is shown below. When the controller is activated at \(t = 1\) s (dashed red line), the rotating mode amplitude decreases rapidly and stabilizes at a substantially lower level, demonstrating effective suppression of the dominant instability.

Time series showing rapid suppression of pressure pulsations after DRL controller activation

Time evolution of the rotating pressure mode. The DRL controller is activated at \(t = 1\) s (dashed red line), after which the pressure oscillation amplitude is rapidly suppressed.

This preliminary study considered a simplified geometry, a single operating condition, and a basic actuation setup to establish feasibility. Extending this framework to realistic turbine configurations, multiple operating regimes, advanced actuator concepts, and higher-fidelity simulations is the next step and constitutes the core of this project.


Scientific innovation

This project introduces the first DRL-based closed-loop control framework for instability mitigation in realistic hydraulic turbine configurations. By integrating DRL directly with high-fidelity CFD of turbines, the project enables a novel control paradigm that moves beyond predefined geometric modifications and open-loop actuation toward regime-robust, efficiency-aware control across off-design operating conditions.


Contact

Feel free to reach out if you have any questions about the project or the PhD position.

Saeed Salehi
Associate Professor of Fluid Mechanics
Linköping University
saeed.salehi@liu.se