Tuesday, 11 July 2023

CASCADE BRIDGE Case Study

As part of the EPSRC CASCADE Programme on aerial robotics, we studied semi-autonomous control for drones inspecting structures.

What kinds of structures?

As the name suggests, we set out to target bridges, and we were especially fortunate to try some early flight trials at the Clifton Suspension Bridge, by kind permission of the Clifton Suspension Bridge Trust.  We were able to prove our ability to fly in the bridge environment (during a planned closure) and to detect the bridge using a simple, lightweight LIDAR sensor.
Unfortunately, rather a lot happened between 2018 and 2023, which meant we were unable to return to the bridge for a full trial of our final system.  Later trials took place at the Snowdonia Aerospace Centre in Llanbedr, North Wales.

What is semi-autonomous control?

For us, it means keeping the pilot in control of the system, while automating appropriate tasks such as monitoring the vehicle health and checking distances.  The drone remains within visual line of sight of the pilot, and the pilot remains vigilant for air risks (other aircraft) and ground risks (e.g. people or vehicles nearby).
This partnership demands a simple interface between the pilot and the control system.  It must not become more complicated for the pilot to figure out what the control system is doing.  For this reason, we adopted simple "traffic light" feedback from the control to the pilot, and a simple "yes/no" input from the pilot to the control.  The concept is inspired in part by railway signalling systems.
Under the hood, we use a behaviour tree to create a modular controller, combining many different checks and actions in a flexible, re-usable way.

What research did we actually do?

  • Developed and validated the concept
  • Designed a set of behaviour tree templates to build different missions
  • Showed how formal safety arguments could be constructed for this combination of human and automation
  • Deployed the system in both immersive simulation and real flight
  • Conducted a human factors trial of the system (results pending)

Where can I learn more?

  • The original case study design is here.  (We didn't do all of it...)
  • A paper on the semi-autonomous drone control concept
  • A paper on mission templates in behaviour trees
  • A paper on safety analysis
  • A paper on the immersive simulation deployment, in collaboration with CASCADE partners at the University of Manchester
  • A good introduction to behaviour trees can be found in the book by Colledanchise and Ă–gren.

Can I try it myself?

Our Python library for control of drones is available on GitHub.

Acknowledgements

Research at the University of Bristol FlightLab by PhD student Hirad Goudarzi supported by technical specialist Duncan Hine.  Supervised by Arthur Richards and Tom Richardson.  Supported by the UK Engineering and Physical Sciences Research Council as part of the CASCADE programme grant EP/R009953/1



Wednesday, 19 August 2015

Should Driverless Cars have Steering Wheels?

Note: these are purely the personal views of Arthur Richards, and do not necessarily represent the views of the VENTURER project or any of its members.

I'm delighted to be part of the VENTURER consortium, trialling autonomous cars in Bristol and South Gloucester.  My role in VENTURER at Bristol Robotics Lab is to deliver a decision-making system for the car, figuring out where to move next given sensor information from other partners' equipment.  We'll not be developing a complete car automation solution, but we will give it just enough brains to do something interesting in the test scenarios.  In particular, we'll be looking at motion planning as a tool to resolve those scenarios that don't really appear in the Highway Code, but occur often enough round Bristol.  Consider a bus trying to pass a recycling lorry opposite some roadworks and with a car trying to pull out of a drive in between...

Since VENTURER started I've had a few regular questions come up.  Google's recent accident raises plenty more (and the reports give us a fascinating view into how the car sees the world),  Here is my FAQ.

Will self-driving cars have steering wheels?

Apparently lots of people want them, because they don't trust technology and want to remain in control.   That seems fair enough: given the frustrating experience of automated checkouts, we're accustomed to the idea that automation needs a bit of supervision.  In a way it makes life easier for us technology developers too: if the driver is still in charge of the vehicle, alert and ready to take control at a moment's notice, then the technology is really only there to assist the driver and doesn't have to be capable of handling all situations.  In short, it doesn't have to be as reliable, because there's a human backstop if it fails.  We call this capability "handover" - the ability to hand over control from computer to human, or vice versa.

But in my view, handover is a fallacy for two reasons.  First, if I still have to remain as alert and responsible for the vehicle as if I'm driving it, what's the point in all this shiny expensive kit to automate it?  Second, if I'm responsible for stepping in when it does something wrong, I need to be very sure that I can recognize "wrong" and know better what "right" is.  That means I have to understand what the automated driving system is doing and why, so I can tell when it's gone wrong.  So, now, not only do I still need to be as alert and capable a driver as I ever was, but I've got a whole load of extra techie stuff to learn about how this fancy gadget works.

You can see more problems with handover if you think about the liability issues.  So let's suppose I'm in my car in auto-drive mode.  I'm as alert as I am now, but I can still easily miss something: 42% of all accidents identify "driver failed to look properly" as a contributing factor. My car picks up on a movement of another car that I've not seen, and reacts.  I don't like the reaction, take control, and have an accident.  Who's at fault?

Meanwhile, if my car is actually pretty good in auto-drive mode, I get used to letting it run.  My own driving gets worse as I'm out of practice, and since I so rarely need to do anything in the car, like it or not, my attention wanders.  So, I'm not as alert as I need to be, and I'm not as practised at what to do.

But can't the car tell me when it needs me to take control?

This too is a fallacy.  The handover capability is there so that if something goes wrong with the auto-driving system, you can take over control of the car.  If the auto-drive is capable of detecting when it's gone wrong, then it should also be able to fix the problem.  This is like saying "I'll call you if I have a problem with my phone."

So there won't be a steering wheel?

Hold on!  I've argued that taking control during driving is a bad idea.  However, a self-driving car is going to be a complicated bit of kit, with lots of sensors, computers and electronics all over it.  Things will break.  Given everything I've said above, the car needs to be able to get you safely to the side of the road, without your intervention, in the event of a failure, and this kind of "fail-safe" engineering is common.  However, a secondary manual driving capability from kerbside to garage is probably essential.  It would be awful if someone only had to back gently into your bumper and that knocked out a couple of sensors and immobilized the whole car.  Your self-driving car is going to be covered with gadgets, and they make most sense to be at the periphery where they've got the best view, so they're going to get bumped in traffic.  The steering wheel here is in a role similar to that of a get-you-home spare tyre: it's not for regular use, but it's there if there's no alternative.

So there is a steering wheel, but I shouldn't be tempted to use it?

Pretty much.  The wheel is there if you want to use it or if, due to some failure, the car can't be started in auto-drive mode.  It's not there for you to take over from auto-drive mode while in motion.

But I still want to be in control?  How can I gain trust in the auto-drive before I'm ready to go all the way?

This is the best question yet, and one to which I don't have a good answer.  This kind of trust only comes from accumulated experience.  I'm reasonably happy to sit on a flight without having watched the pilot fly a few times before, or studied the design of the aircraft.  Instead, I base my trust in the history and culture of the airline and aviation business.  So, somehow, all the stakeholders in auto-driving cars need to find a way to earn this trust.  Easy to say...

Will my self-driving car be more efficient?  Will it help the environment?

Interesting question.  There are many different ways in which this technology will impact the environment, especially vehicle emissions.  I've not run the numbers but we can think about the qualitatively at least.  For the purposes of this thought experiment, assume that a self-driving car means one that can drive itself with no human driver attention, but is otherwise identical to any other car.  (People tend to think of self-driving cars as futuristic electric vehicles, but you could apply that technology to manually driven cars just as well.  The same goes for regenerative braking or auto-engine-stopping in traffic.  Let's keep those separate from self-driving technology.)

On the plus side, how will self-driving cars help the environment?

The automated driving system ought to improve efficiency by optimizing acceleration and braking profiles and gear changes if necessary.  Not sure how significant these are though.  Optimizing speed would be a more meaningful impact, but how often is speed free to be optimized, rather than set by congestion? Not that much.

One significant positive impact could be in reduction of accidents.  If self-driving really does lead to fewer accidents - and if it doesn't, there was very little point - then there could be significant reductions in knock-on congestion.  Also, if the reduction in accidents could reduce the carbon costs of building spares and new ones - because there are fewer cars damaged or written off in accidents.

Long term, after a significant uptake of self-driving cars, congestion could be ameliorated by cooperative routing strategies.  Self-driving technology goes hand-in-hand with the connected car concept, and although you could add vehicle-to-vehicle (V2V) or vehicle-to-infrastructure (V2I) capability to any car, they seem pretty likely to come together.  Imagine an optimized response to high-bandwidth traffic reporting.

OK, the negative side: how will they hurt the environment?

Potentially, self-driving cars could lead to an increase in traffic levels, with all the knock-on congestion and environmental detriment that would bring.  We all make value-driven choices when choosing modes of transport.  I often prefer to take a train instead of drive because I can work on the way, or arrive refreshed instead of tired after driving.  The train's rarely cheaper though, and I still have to cover the door-to-station bits myself.  But, if my car can drive itself, I can go door-to-door and still get the work done or rest.  Trouble parking at the far end?  No problem - I'll send the car off to park itself and call it back later on.

Also, full self-driving opens up the possibility of personal car transport for people who can't actually drive manually.  Would we still expect people to stop using their own cars due to eyesight, illness or just plain old age?  Invariably there will be limits, but if self-driving technology emerges, it would be very harsh to withhold it from those who could benefit most in terms of independence.  There are some interesting possibilities for the school run too, but don't let's get too carried away.

The main point is that fully-automated driving technology removes a number of disincentives to the use of your own car for any given journey: the need to be capable (and perhaps qualified) to drive the car; the mental exertion of driving the journey; your own time spent driving the journey; and potentially some of the time and effort in parking at the other end.

I've not run the numbers on any of these, and it'd be a big project to do properly anyway.  What would be the net effect?  Hard to say, but it's not "given" than self-driving cars will be good for the environment.

If two people run into the road from different sides, and the car can only physically miss one of them, how will it choose?

There are lots of variations on this question, involving various combinations of unfortunate potential victims.  It turns out that this is a variant of the well-studied trolley problem in ethics, and some argue that this question is at the heart of self-driving car technology.  I disagree.

That's not to say I'm flippant about safety.  Far from it.  I will do all that I can to make sure that any decision-making system I develop has minimal chance to ever end up in a situation where it might have to choose who to kill.  Then I'll do some more to reduce that chance.  But once in that situation, things have already gone badly wrong.  The boundary of what's acceptable vs. what isn't lies before that judgement point is reached.  Because things always go wrong sometimes, I cannot guarantee that we'll never cross that boundary, but as an engineer my priority is to minimize the chance of crossing it.

There's nothing in the highway code about how a human driver should choose, or any other legislation that I'm aware of.  It's suggested that human drivers can be forgiven for poor choices in the trolley problem because they don't have the time to consider it ahead of time - but then if it's so important, why isn't it in the driving test?

Personally I'm also a little chilled by the idea of programming my computer to make value judgements about human lives.  Presumably if it got it right, it'd tell me my journey isn't worth the risk anyway.  I'd rather spend my time improving the car's ability to anticipate where people might run out in front of it.  I hope I've not been at all flippant about this question, but it really is a distraction.

Thursday, 16 July 2015

Tutorial Presentation on MPC for Aircraft

Thank you to Pantelis Sopasakis from IMT Lucca for inviting me to participate in a tutorial session on Model Predictive Control for Aerospace at the European Control Conference in Linz, Austria.  Presentation topics ranged from spacecraft rendezvous to UAV guidance.  I limited my talk to fixed-wing aircraft, but covered three different case studies:

  • Nonlinear MPC for a UAV avoiding oncoming aircraft
  • Mixed-integer linear MPC for an aircraft flying in a forest
  • Mxed-integer linear MPC for air traffic flow
Click here or on the image below to get the slides from my talk.



And to close, a nice picture of the Danube by night!

Untitled

Monday, 12 January 2015

Flying a Drone in the Royal Institution Christmas Lectures

In December 2014, the first cohort of FARSCOPE Centre for Doctoral Training students developed an automated drone cymbal player to take part in an RI Christmas Lecture.  FARSCOPE Director Arthur Richards reflects on the experience.

The Royal Institution approached Bristol Robotics Lab in November 2014 to ask if we could contribute a drone to their robot orchestra project, inspired by this YouTube video and others.  The brief was quite broad: get a drone to play something somehow.  We agreed to investigate and see what we could do.  In particular, we made this a "crash project" for the new FARSCOPE students, perhaps a poor choice of term under the circumstance, but highlighting the emphasis on simplicity and timeliness of whatever we came up with.

Drones are tough to control with great accuracy, so we quickly narrowed our ideas down to percussion.  My personal, and slightly ironic, wish was to have a drone play the triangle This urge was quickly subdued, both by the drowning of the triangle sound by the motor noise, and the alarming response of the drone when affixed with a beater and flown into a triangle.  It was clear that some sort of transmission would be required to strike the instrument.  Electrical transmission was ruled out, as we wanted it to be obvious that it was really the drone making the noise.  Therefore, we had a requirement for a mechanism that would convert some motion of the drone into motion of the beater striking the instrument.

CDT Student Dave wheels the drone kit into the Faraday Lecture Theatre
Around this point, I started to have unsettling thoughts about a drone flying into a live audience of youngsters, never mind in front of TV cameras.  Consultation with the production team indicated that a perspex shield would give reflection problems, and our ideas for cages made fishing wire just seemed pretty outlandish.  So, the drone would have to be tethered.  This neatly solved the mechanism debates as well, as the tether would serve to actuate a beater.  So, with a few weeks to go, we had a concept: a drone tethered to a pivoting arm, which would crash into a cymbal when pulled upwards.  All this could be mounted on a trolley, conveniently also serving as transport and landing pad.

Meanwhile, other details had been falling into place.  Students had been building QAV250 quadrotor drones and equipping them with Naze32 flight stabilizers.  These turned out to be excellent machines, mechanically robust, well-stabilized, and easy to fly for beginners, so very suited to our needs.  Some Arduinos were programmed to take commands from our ROS environment and convert them to PWM streams for the trainer port of our radio transmitters, with an added emergency stop functionality.  With our Vicon motion capture system tracking the drone, we were able to close the loop.  One day we may share the radio control bridge and PID tuning packages with the ROS community, but it's the nature of crash projects that things aren't done as tidily as they could be.

Students put finishing touches to the drone landing pad in the RI library
With a van full of spare drones, computers, markers, cameras, tools and fishing wire, we headed to London for the first of two long days rehearsing and filming.  With plenty of practice in the lab and enough spare kit to do the whole project twice, we would be confident, but nevertheless the first successful cymbal clap when hooked up to the orchestra was a great relief all round.  As so often in robotics, the thing that came closest to stopping us was a flaky network.

One surprise was yet to come: the producers liked the drone so much they wanted to make more of it, so we quickly contrived a demo for it to follow an external target.  For comedy reasons and as a nod to the computer vision world, it had to be a teapot.  It's a great credit to the students involved that an extra function was written into the software at about an hour's notice, but that went on to work beautifully.

FARSCOPE students at the control station, backstage at the RI.
You can see the finished product late on in the video at the RI Channel: Sparks Will Fly: How to Hack Your Home  For the cynics, there was absolutely no cheating involved.  There was a manual transmitter out back but it was never used during filming, and the only manual intervention was me pressing the button to land the drone, giving lecturer Danielle a bit of a fright.  (Ground effect when the downwash hits a surface makes it hard to fly a drone very low and keep it tightly controlled - you're better off just cutting the power once low and slow.)  Everything you see in the video is genuinely automated, with students pressing only a start button and switching the teapot tracking on and off.

So what do we learn from all this?  Drones will clearly not be great musicians in the near future.  Still, the students learnt a wide range of practical skills through this exercise, from ROS use to drone construction.  Time management, teamwork and the importance of testing were also reinforced, although this was far from a good model of systems engineering.  Finally, it was great for those of us running FARSCOPE in its first year to explore the flexibility and responsiveness that the Centre for Doctoral Training gives us.

Thursday, 20 February 2014

Show and tell

I've been doing lots of demonstrations and presentations lately - here's a collection.

First was a very interesting workshop at the ASAP group in Nottingham, supported by the LANCS initiative, talking about applications of operations research to air transport problems.  Agenda and talks are available for download here, including my report of our work on aircraft taxi optimization and air traffic flow management.

Next was a more high level event at Southampton, the Autonomous and Advanced Systems Showcase event.   This covered various opportunities and initiatives at the intersection of aerospace and autonomous systems, ranging from market opportunities to the latest research details.  Extensive video reporting can be found here, including my report on the work of Bristol Robotics Lab in this area.

The Duke of York visited BRL on Feb 10th and was treated to, among other things, a display of our autonomous flying robots in a building exploration scenario.  The photos are here.

And finally, I was asked to comment on the recent Amazon UAV delivery proposals by a packaging trade magazine.  The article is here.

Monday, 27 January 2014

FARSCOPE Centre for Doctoral Training - NEW WEBSITE

The new and settled home for information on the FARSCOPE Centre for Doctoral Training in Robotics and Autonomous Systems is: farscope.bris.ac.uk

Thursday, 19 December 2013

FARSCOPE

In 2014, the Bristol Robotics Lab (BRL) will be launching a new Centre for Doctoral Training in robotics and autonomous systems.  The Centre will offer a joint PhD degree run by BRL's two partner universities, the University of Bristol and the University of the West of England.  The Centre is funded by EPSRC following their CDT 2013 competition.
The new CDT is entitled "Future Autonomous Robotic Systems Centre of PhD Education" - FARSCOPE.  In time FARSCOPE will have its own website with full information on the programme and how to apply.  Until then, the latest information and news for prospective students will be found here.

Theme

FARSCOPE is all about making robots more adaptable.  Instead of doing the same jobs over and over in  large factories, they'll help us in our homes, work alongside us in small businesses, and deal with hazardous situations while we keep a safe distance.  To make all this happen, we face three challenges:
  •  robots being part of society, interacting with people, machines or other robots, and handling all their unpredictable behaviour
  •  robots operating in uncertain environments, sensing, mapping and moving where existing maps and plans are inaccurate or unusable.
  •  requiring different roles of robots with regular changes, for small batch jobs in small businesses where two days downtime to reprogram isn't an option.
Together, these challenges make up our theme of adaptability.  The technologies involved are diverse and the applications are many, but anything to do with the three challenges above is within the remit of FARSCOPE.

Programme

FARSCOPE enhances the "traditional" PhD content of individual research with taught content on a range of robotics topics and more general skills.  Not only does this better prepare you for PhD research, but it gives you a broad view of robotics and autonomous systems that we believe is essential. There's so much to be learnt by seeing what's been done in different fields and applications: manufacturing benefits from autonomous exploring ideas and spacecraft can exploit UAV breakthroughs, to name just too.  In short, we want you to be adaptable too, in your skills and what you can do with them.

Year 1

  • Research methods training
  • Seminars in modern robotics methods
  • Robotics, mechanics and programming
  • Robotics context and applications (industry delivered)
  • Robot intelligence and systems
  • Specialist robotics topics (chosen from list of options)
  • Group robot project (eg IMAV contest, robot soccer or Mars rover field test)
  • Initial research project
  • Communications training and research presentation

Year 2

  • PhD research
  • Industry study workshop
  • Innovation and entrepreneurship
  • Complementary skills training

Year 3

  • PhD research
  • Industry study workshop
  • Partner placement (optional: opportunities at partner universities in Europe, Asia, North America or partner companies in the UK and Japan)
  • Public engagement training and group activity

Year 4

  • PhD research
  • Complementary skills training (including thesis preparation)
  • FARSCOPE conference presentation

More Information

More details will appear here and on our website as it becomes available.  For questions or if you're interested in applying, please contact arthur.richards@bristol.ac.uk

Wednesday, 3 April 2013

Flying Robots

This video actually dates back to January and we've done more since, but I've been meaning to post it anyway.  The video shows three different runs of the same controller, flying a Parrot AR.Drone through a virtual array of obstacles (i.e. the computer thinks they're there, but they're not).  The controller uses Model Predictive Control (MPC), solving a constrained optimization every 20ms to decide what to do next.  The clever bits are converting the global problem into a convex local optimization that we can solve quickly and deploying the solver in Simulink so the whole thing can be controlled by a dSpace MicroAutobox.  THe control is a little wobbly here but we've fixed that now, with disturbance estimation, better terminal constraints, and some careful tuning.

This work was carried out in our indoor flying arena.  (Much of the purpose of this post is to provide an excuse to post the photo of this arena below.)  This is an empty space 15m x 12m x 4m high, enclosed by curtains and instrumented with a Vicon motion capture system, now up to ten cameras.  We don't currently build our own aircraft - we just buy them off the shelf, so we can concentrate on developing the controllers for them.  The end goal is to make micro air vehicles (MAVs) that are more autonomous, able to say fly into a damaged building, explore and then come back out, without needing a highly skilled pilot to fly it and keep track of where it is.

Flying Arena

One way you can get involved in research like this is our joint Robotics MSc, run by the University of Bristol and the University of the West of England.  The degree is based at the Bristol Robotics Lab and includes the opportunity to do research projects using our flying robots.  More details can be found at http://www.bristol.ac.uk/engineering/interdisciplinary/robotics/ 

Thursday, 7 March 2013

Visiting

Use the map below to help find me! Visitor parking at the University can be found at the yellow "P" markers. Spaces must be pre-booked. Zoom out for the airport.
View Visiting Arthur Richards in a larger map

Wednesday, 23 January 2013

AMPL Toolbox

Only ten years after writing the thing, I've finally got around to making the AMPL toolbox for Matlab available on the Mathworks File Exchange: http://www.mathworks.co.uk/matlabcentral/fileexchange/39795-ampl-data-file-toolbox

AMPL (see http://www.ampl.com/) stands for "A Mathematical Programming Language" and allows optimization problems to be written in a language close to how you'd write in in equations.  It also takes care of a great deal of "housekeeping" tasks like enumerating variables and constraints over sets of indices.  To solve an optimization, the AMPL executable typically combines a model file, containing the structure of the problem in terms of symbolic variables and parameters, with a data file, containing parameter values, to create a binary "NL" file encoding the whole problem.  Then an external solver (e.g. CPLEX, Gurobi or IPOPT) is invoked to solve the problem in the NL file and report results back to AMPL.

The AMPL-Matlab toolbox contains a series of utilities for writing the AMPL data file from Matlab.  Since MATLAB can also read data back from AMPL easily (just redirect an AMPL "printf" command to a file and use "load" in Matlab), this means you can do the whole process of optimization and data analysis in Matlab scripts.  OK, all that file writing and reading isn't the fastest way of doing business, and if you know exactly what you want to deploy in anger, you'd do it differently.  But, if your business is in tinkering with the structure of the optimization and the algorithm, as ours is, this makes an excellent rapid prototyping tool.

We've used this approach in our work on robot navigation and flight routing, among many other things.

Saturday, 8 December 2012

Journal Paper: Cooperative distributed MPC

I'm pleased to learn that our latest paper is now available on the Automatica website:

Paul Trodden, Arthur Richards, Cooperative distributed MPC of linear systems with coupled constraints
Automatica, Available online 4 December 2012, http://dx.doi.org/10.1016/j.automatica.2012.11.007

Thanks to Paul Trodden for all his hard work on this paper, which reports on his PhD findings on how inter-agent cooperation can improve performance, e.g. by breaking deadlocks between greedy agents.  Congratulations as well to Paul on his recent move to the University of Sheffield's Automatic Control and Systems Engineering department.

Tuesday, 21 August 2012

GNC

Pillsbury A Mill and Stone Arch Bridge, 4th of July

I'm just back from the AIAA Guidance Navigation and Control (GNC) Conference in Minneapolis.  There were many interesting things to see and I can't do justice to it all here, but if only for my own memory, here are a few of the most relevant papers.  (Note on referencing: there doesn't seem to be an easy way to link into the AIAA database.  Instead, I'll just provide paper numbers, AIAA-2012-XXXX.  You can search by number in the AIAA Electronic Library.)

Starting with the Air Traffic Management domain, it was interesting to see nonlinear trajectory optimization applied (AIAA-2012-4755) and EADS' work on modeling noise in trajectory optimizers (4482).  Meanwhile UCSC presented some work on formation flight for civil airliners (4524) and our own Tom Kent did a good job of presenting his recent PhD work in this area (4769).  Finally, MITRE's work on flow contingency management (4976) nicely complements our own work on the ONBOARD SESAR project.

Heading into space, Iowa State made a very elegant job of rendezvous optimization by using conic programming (4924), solving many of the challenges we encountered in the ORCSAT project while still having a convex optimization at the core. In the very next paper, a consortium including ESA and the University of Exeter proposed methods for verification and validation of spacecraft rendezvous controllers based on both numerical and analytical methods for finding worst case behaviour.  Louis Breger presented an elegant approach to fault detection (4611) which I'm sure should be in an optimizer somehow...

There was an enormous range of work in the UAV area.  Starting at the practical end, it was interesting to see indoor flight testing using the same fixed-wing Night Vapor aircraft as in our experiments (4464), including gust response work.  Adaptive control seems to work nicely for MIT's quadrotors (4551) and others from Seoul with attached manipulator arms (4835).  There were whole sessions on vision-based control (5048 to 5051) including Steve Waslander's dampening experiences of chasing icebergs (5049): it was also interesting to see latency handled by simple linear approximations in these works.  Moving to higher level control of teams and tasking, there were developments in optimization from Toronto (4680) and planning based on data-driven learning from MIT (4682).

And let's not forget the discovery of the bizarre love of lawn green bowls in Minneapolis - quite surreal.

Friday, 20 July 2012

Optimal Transatlantic Routes for Formation Flight


View Larger Map

The map above illustrates the results of Tom Kent's work on formation flight for airliners. These are the optimized routes for 210 eastbound transatlantic flights, allowed to fly in pairs in formation in order to save fuel.  The optimization does not consider the timing of the flights - it is assumed that they coordinate to achieve their rendezvous.  However, it does determine which pairs should be formed and where each pair should join and then break apart.  Interestingly, many formations share the same departure point: zoom in on Atlanta or Heathrow, for example, or observe the LAX-Dublin teaming with the SFO-Dublin flight.  There are also some curiosities like the Newark-Lisbon flight joining up with the flight from Boston to Lajes in the Azores.

Tom's methods and initial results will be presented at the AIAA Guidance Navigation and Control conference this August.

Thursday, 10 May 2012

Bristol Robotics Lab now officially open

The Bristol Robotics Lab (BRL) was officially opened this morning by the Universities and Science Minister, David Willetts.  BRL is a joint venture between UWE and the University of Bristol, located at UWE's Frenchay Campus.  Aerospace colleague Tom Richardson and I are particularly excited about our newly-equipped flying arena, one of the biggest in Europe at about 15m x 12m x 4m high.  Thanks to funding from DSTL and support from Vicon and dSpace, it is now instrumented for real-time flight control and enclosed with protective nets and curtains.

Coverage of the BRL opening can be found at:
http://www.itv.com/news/west/2012-05-10/robotics-lab-opens-in-bristol/
http://www.bbc.co.uk/news/uk-england-bristol-17994891
http://www.thisisbristol.co.uk/UK-s-biggest-robot-laboratory-opens-Bristol/story-16039940-detail/story.html
http://info.uwe.ac.uk/news/UWENews/news.aspx?id=2272

The introductory video also includes some of our flight demonstrations: http://www.youtube.com/watch?v=pgYM-Dgc9yE

More about our Unmanned Air Systems project can be found at https://wikis.bris.ac.uk/display/agc/Optimization-based+Exploration+for+Small+UAS

Special thanks to postdoc Colin Greatwood for his hard work in getting the flight demonstrations ready for the opening.

Thursday, 12 April 2012

Two fully funded PhD opportunities

UPDATE: these posts have now been filled.

Two fully-funded PhD studentship opportunities are available for EU nationals starting between now and October 2012.  Updated with jobs.ac.uk links - see below.


Routing and Tasking Optimization for UAVs
This project will develop novel optimization techniques for the joint task allocation and routing of a small team of Unmanned Air Vehicles (UAVs).  Given a number of surveillance tasks, times to travel between task locations, available UAVs and remaining fuel levels, we have an initial method of finding the best routes and allocations.  This project will look for ways of making this faster and more robust, by combining different types of optimization (e.g. branch-and-bound, genetic algorithms, simulated annealing).  The project will also look at applying machine learning techniques to try and predict the user's requests before they're even made: make the answer available before the question's even asked.  Applicants should have a good first degree (2:1 or higher) in engineering, mathematics, computer science or a related subject.  Experience of optimization, operations research, machine learning or other relevant techniques would be beneficial. More information can be found at: http://www.jobs.ac.uk/job/AEL165/phd-studentship-in-routing-and-tasking-for-teams-of-unmanned-air-vehicles/

Multifunctional Air Deployed Exploration Nodes (MAiDENs)
(Applicants are free to suggest a better acronym!)  Imagine a micro UAV exploring a building.  Its battery is made up of many small cells, and whenever one is getting low on charge, it is dropped.  The UAV now has less weight so its flight time is extended.  Meanwhile, some extra electronics on each dropped cell makes use of the remaining charge: (a) it relays communications back to the outside world (b) it uses a small acoustic sensor to alert the UAV to changes in the world (c) when the UAV is ready to leave, it turns on a small beacon to act as a breadcrumb for the trail back out.  Now, all we have to do is see how well this can be achieved in, say, a gram, and figure out how best to deploy the idea.  For this project, applicants should have a good degree in electronics, robotics, engineering or similar, and experience of low power electronics will be a great help.  THis project will be jointly supervised by myself and colleague Steve Burrow.  More information can be found at: http://www.jobs.ac.uk/job/AEL166/phd-studentship-in-novel-multifunctional-power-systems-for-micro-air-vehicles/

Both studentships will be held in the Department of Aerospace Engineering, part of Bristol’s Faculty of Engineering. The projects will be affiliated with the Bristol Robotics Lab, utilizing the large indoor flying arena for experiments. Stipends will be at the standard level of £13,590 p.a. plus a top-up of £3,000 p.a. 


To apply, visit http://www.bristol.ac.uk/prospectus/postgraduate/2012/apply.html . On your application form, identify “PhD in Aerospace Engineering” as your chosen degree programme, Dr Arthur Richards as your proposed supervisor, and either (or both) of the two projects above as your proposed topic. Please use the “Proposed Research” section of the application to discuss your interest in the particular project(s). 

New UAV Exploration Project

We are beginning a new project on indoor exploration using small Unmanned Air Systems (UAS).  Colin Greatwood (shown right) is staying on after his PhD to develop new algorithms for exploring unknown environments without the use of GPS.  These techniques will allow UAS to investigate hazardous environments such as collapsed buildings or damaged nuclear or chemical plants.  This is a missing piece in a very big puzzle: we have worked on getting from A to B in cluttered environments and figuring out where the vehicle is without GPS: this project will help when we don't even know where B is and we need to explore.

A significant part of this project, funded by DSTL via the Centre for Defence Enterprise, is the equipment and commissioning of our large flying area at the Bristol Robotics Lab (BRL).  Colin is shown in the arena flying a AR Drone Parrot quadrotor in the photo.  With support from Vicon and dSpace, we will be equipping the arena with video tracking cameras and real-time control computing hardware.  The result should be one of the largest instrumented flying arenas in Europe.

Tuesday, 3 January 2012

New Air Traffic Management Projects

Left-to-right: Gillian Clare, Ollie Turnbull and Tom Kent
I'm delighted to welcome three new members to our research group, all working in the area of Air Traffic Management (ATM) and air traffic operations.  I must admit that "new" is a relative description here, as two of the three are rejoining us after spells away.

Gillian Clare rejoins us to work as a postdoctoral researcher on the "ONBOARD" project.  ONBOARD is a research project within the WP-E Long Term and Innovative Research Work Package of SESAR, the Single European Sky ATM Research joint undertaking.  Led by Spanish technology group GMV and in collaboration with Swiss ATM developers Skysoft, ONBOARD stands for "Probabilistic Network Based Operations ATM R&D".  The goal of the project is to improve large scale operations planning by incorporating probabilistic models of the uncertainty in the system.  Gillian's role will be to develop the "Network Manager" that solves the ATM flow problem robustly, to suit the uncertainty information available.  The work will also involve research into the development of the probability models themselves, to cover capacity factors including weather and scheduled demand.  Read more about the ONBOARD project at its page on the ComplexWorld ATM research network.  Gillian herself is familiar to this blog, having done her PhD with us, studying optimization of airport taxi operations, and rejoins us after a spell in industry.

Like Gillian, Ollie Turnbull also did a PhD here, using decision trees to clone the behaviour of trajectory optimizers, before moving to industry.  Ollie rejoins us now as the postdoctoral researcher on our second SESAR WP-E project, SUPEROPT.  This project is led by and completely performed by ourselves at Bristol.  SUPEROPT stands for "Supervision of Route Optimizers" and seeks to enable more intuitive human interactions with optimizers.  As many frustrated Sat-Nav users will know, route optimizers are often worryingly good at finding the loopholes in the problems we set them, especially when we try and modify the routes using our own experience.  SUPEROPT aims to develop forms of constraints that enable the supervisor to easily influence the outcome, but without overconstraining the result.  Likewise, enhanced information on the result will be developed to convey the rationale to the supervisor: why is the result the way it is?  With this two-way interaction, we hope to leverage the power of computer optimization without losing the hard-earned experience of human operators.  Read more about SUPEROPT on the HALA! ATM research network page.

Finally, Tom Kent joins us to study for a PhD in future air traffic operations.  Supported by Airbus UK at Filton and EPSRC, Tom is exploring the mathematics underlying novel concepts for aircraft operations with reduced environmental impact and cost, starting with formation flight.  This idea is described in this Future by Airbus video and was demonstrated on a small scale by NASA.  It worked for two F/A-18s following the same route, but what about airliners on different routes?  Tom's work looks at when and where airliners should meet, if at all, to save fuel by flying in formation.  Tom joined us after completing a Maths degree at Edinburgh.  His background serves him well, as these problems are turning out to involve some very elegant geometry: watch this space to see how it all relates to Fermat...

Friday, 16 December 2011

Forthcoming Automatica paper: Multiplexed MPC

Keck Voon Ling, Jan Maciejowski, Arthur Richards, Bing Fang Wu, Multiplexed model predictive control, Automatica, Available online 15 December 2011, ISSN 0005-1098, 10.1016/j.automatica.2011.11.001.

Abstract: This paper proposes a form of MPC in which the control variables are moved asynchronously. This contrasts with most MIMO control schemes, which assume that all variables are updated simultaneously. MPC outperforms other control strategies through its ability to deal with constraints. This requires on-line optimization, hence computational complexity can become an issue when applying MPC to complex systems with fast response times. The Multiplexed MPC (MMPC) scheme described in this paper solves the MPC problem for each subsystem sequentially, and updates subsystem controls as soon as the solution is available, thus distributing the control moves over a complete update cycle. The resulting computational speed-up allows faster response to disturbances, which may result in improved performance, despite finding sub-optimal solutions to the original problem. This paper describes nominal and robust MMPC, states some stability results, and demonstrates the effectiveness of MMPC through two examples.

Keywords: Predictive control; Distributed control; Multivariable control; Periodic systems; Constrained control

Thursday, 15 December 2011

Recruiting again! PhD opportunity on Micro Air Vehicle navigation

UPDATE: this post has been filled.

A fully-funded studentship is available for a PhD on the topic of autonomous indoor flight of a Micro Air Vehicle (MAV) using computer vision. The focus of the project is on the guidance, sensing and control aspects of the problem. It will build on prior work on visual SLAM and MAV control, and off-the-shelf platforms will be used for experiments. In particular, the project will seek to optimize trajectories and motions for the use of vision as a navigation sensor. The work will combine analysis, numerical simulation and hardware experiments. The studentship is supported by dstl (Defence Science and Technology Laboratory: http://www.dstl.gov.uk ) and is part of a larger activity to develop future capabilities for building exploration in hazardous environments.

The studentship will be held in the Department of Aerospace Engineering, part of Bristol’s Faculty of Engineering. The project will be run in collaboration with the Department of Computer Science and will be affiliated with the Bristol Robotics Lab, utilizing the large indoor flying arena for experiments. Stipends will be at the standard level of £13,590 p.a. plus a top-up of £3,000 p.a. The project is aiming to begin in early 2012.

The successful applicants will all hold good (minimum 2:1, preferable first class) first degrees in engineering, robotics, computer science, mathematics or a related discipline. Experience in one or more of: computer vision; flight mechanics; control; or numerical optimization would be highly desirable. Due to funding restrictions, only EU nationals are eligible for this studentship.

For more information, please see the pages of the academic supervising team, listed below. For general enquiries, please contact Arthur Richards, whose contact details can be found on the page below. To apply, visit http://www.bristol.ac.uk/prospectus/postgraduate/2012/apply.html . On your application form, identify “PhD in Aerospace Engineering” as your chosen degree programme, “Flying with Vision” as your desired topic and Dr Arthur Richards as your proposed supervisor. Please use the “Proposed Research” section to discuss your interest in this particular topic.

- Andrew Calway: http://www.bris.ac.uk/engineering/people/person/andrew-d-calway/overview.html
- Walterio Mayol-Cuevas: http://www.bris.ac.uk/engineering/people/person/walterio-w-mayol-cuevas/overview.html
- Arthur Richards: http://www.bris.ac.uk/engineering/people/arthur-g-richards/overview.html
- Tom Richardson: http://www.bris.ac.uk/engineering/people/tom-s-richardson/overview.html

Friday, 8 July 2011

EUCASS

Hermitage, St Petersburg
I'm just back from attending the European Conference on Aerospace Sciences (EUCASS) in St Petersburg.  Visiting Russia and the imposing city of St Petersburg was a great experience, but I'll try to keep to the technical side in this post.

There was much coverage of launchers, not really my field but interesting anyway.  A concept caught my eye for using a GlobalHawk UAV to lift a launcher rocket for small satellites, similar to the Pegasus system - only got a brief glimpse though.

My student Colin Greatwood presented his work on collision alerting for helicopters, while colleague Massimiliano Saponara from Thales Alenia Space Italy presented results from our ORCSAT study with ESA.  It was interesting as well to see Princeton Satellite Systems proposing something MPC-like for rendezvous in their Space Rapid Transit system.

Finally, an idea: has anyone ever tried MPC for aircraft fuel system management?