AI in Piloting (AI-Augmented flight) and in Aircraft Inspection and Maintenance

AIAeroscan

New Member
Hi,

We are a team of AI/Data Science specialists, and we want experts and amateurs from aviation industry to asess potential benefits of AI. Please help us understand the need of modern technologies in the field of Aircraft Piloting and Aircraft Inspeciton and Maintenance.

-Would you be willing to use an AI-augmented system during piloting?

- Are you interested in an AI-based Aircraft Inspection technology (statistics on number of defects, number of deformites, level of damage, prediction, etc.)?

Thank you!
 
I would definitely be interested in AI helping us figure out the number of deformites.......I'm never fully comfortable with my own estimate of the deformite count

Can it do this while I'm piloting?
 
That sounds fascinating! AI-based aircraft inspection technology could revolutionize how we ensure aircraft safety and maintenance. It could potentially improve efficiency, accuracy, and safety standards in the aviation industry. Do you have specific statistics or data on the effectiveness of such technology?

AI-augmented systems in aviation, such as autopilots and flight management systems, are already widely used and have contributed to improved safety and efficiency in air travel.

Integrating AI further into piloting could offer benefits such as enhanced navigation, real-time decision support, and automated systems for managing complex flight tasks. However, it's crucial to ensure that any AI systems used in piloting are thoroughly tested, reliable, and capable of handling various scenarios, including emergencies.

Ultimately, the acceptance and adoption of AI-augmented systems in piloting will depend on factors such as regulatory approval, pilot training, and industry trust in the technology's capabilities.
 
That sounds fascinating! AI-based aircraft inspection technology could revolutionize how we ensure aircraft safety and maintenance. It could potentially improve efficiency, accuracy, and safety standards in the aviation industry. Do you have specific statistics or data on the effectiveness of such technology?

AI-augmented systems in aviation, such as autopilots and flight management systems, are already widely used and have contributed to improved safety and efficiency in air travel.

Integrating AI further into piloting could offer benefits such as enhanced navigation, real-time decision support, and automated systems for managing complex flight tasks. However, it's crucial to ensure that any AI systems used in piloting are thoroughly tested, reliable, and capable of handling various scenarios, including emergencies.

Ultimately, the acceptance and adoption of AI-augmented systems in piloting will depend on factors such as regulatory approval, pilot training, and industry trust in the technology's capabilities.
I’m like 90% certain that I see what you did here.
 
Hi,

We are a team of AI/Data Science specialists, and we want experts and amateurs from aviation industry to asess potential benefits of AI. Please help us understand the need of modern technologies in the field of Aircraft Piloting and Aircraft Inspeciton and Maintenance.

-Would you be willing to use an AI-augmented system during piloting?

- Are you interested in an AI-based Aircraft Inspection technology (statistics on number of defects, number of deformites, level of damage, prediction, etc.)?

Thank you!

No.
 
Hi,

We are a team of AI/Data Science specialists, and we want experts and amateurs from aviation industry to asess potential benefits of AI. Please help us understand the need of modern technologies in the field of Aircraft Piloting and Aircraft Inspeciton and Maintenance.

-Would you be willing to use an AI-augmented system during piloting?

- Are you interested in an AI-based Aircraft Inspection technology (statistics on number of defects, number of deformites, level of damage, prediction, etc.)?

Thank you!

Fancy new words for systems that already exist. Fabulous.
 
Hi,

We are a team of AI/Data Science specialists, and we want experts and amateurs from aviation industry to asess potential benefits of AI. Please help us understand the need of modern technologies in the field of Aircraft Piloting and Aircraft Inspeciton and Maintenance.
Do you have a link to your company? Because this is suspicious. Multiple typos and weirdly ESL phraseology lends very little credibility. Tell us about your organization. Nevertheless, I'll entertain this a bit to see if it can gin up better conversation in the thread about this stuff.
-Would you be willing to use an AI-augmented system during piloting?
Absolutely, but it would have to be "good" in a way that most of the LLMs currently aren't. For the time being the only models I'd be willing to trust until they were tested aggressively would be simple rule based models, and decision tree type classifiers. I would absolutely not be comfortable using neural networks in any safety sensitive applications without a LOT of oversight and guardrails.

Not that they're not useful - I use them all the time - but black box models are hard to comprehend and the generative tools that exist now are are not reliable enough to trust in safety sensitive functions. That said, they get better every day, it's really exciting.

Some things I think would be good that are close to the AI and AI adjacent space would be speech-to-text if it was accurate enough. Sometimes it would be nice to simply read your clearance. Imagine you've got the iPad out and it's listening to the radio too. "ATC Clears N12345 from ABC to XYZ via the DeezNuts1 Departure, Radar Vectors SHLNG V247 to the Crazy Woman VOR then Direct, climb and maintain 6 thousand, expect flight-level 900 10 minutes after departure, departure frequency will be Grab Ass Center on 123.45, squawk 6666." Then you can just read it back off the iPad - especially for full route clearances. Apparently people are working on this presently:
AI speech recognition ventures into the cockpit and if it could get accurate enough, this could be fantastic for helping prevent runway incursions etc. but the testing would have to be incredible.

Other cool applications would be better/airframe and even aircraft specific performance data in GA. I would have loved a tool that could help me reliably reduce fuel burns during flight, etc. but I doubt that is really feasible. I'd love AI guage interpretation with cameras so a $500 GoPro means that every little airplane has a black box, and I'd love tools that could help teach flying by being a virtual CFI and developing a recap of the flight etc. for review after the flight. There's stuff that's getting there, but it's not really AI enabled - though maybe someone has produced some cool new stuff in the last couple years while I've been in school.

I see a huge amount of potential in 135 in dispatch/flight-follower augmentation though, and eventually maybe even in ATC, though that's probably further out. I could see a lot of tooling to help get rid of friction between the customers and the company in GA. Our entire inventory was basically on a whiteboard and notification of customers had to come from a dispatcher remembering Annie Jo's phone number and calling her. AI could probably help there under certain circumstances, but I don't know if the juice is worth the squeeze.

I just read this paper yesterday: https://arxiv.org/pdf/2304.03442 That talks about using LLM generated AI agents to do some party planning, and this amazing paper: [2405.02957] Agent Hospital: A Simulacrum of Hospital with Evolvable Medical Agents that uses AI agents in a simulated hospital. If these applications turn out to be legit this would be an excellent area of focus to automate some of the ground/support roles or at least provide a check of human performance. It can be done, but it's a matter of figuring out how much money you want to spend.

In the airplane, other than the actual act of flying itself (i.e. better autopilots), I have a hard time seeing what generative tools could really do to help day to day operations and presently NNs have a long way to go before I would trust them with full control. Obviously, ML in other forms is very practical for some more narrowly focused tasks, but since the term you use "AI" is so broad it's hard to tell what you're getting at.

- Are you interested in an AI-based Aircraft Inspection technology (statistics on number of defects, number of deformites, level of damage, prediction, etc.)?
I'm not sure what a "deformite" is - but, most companies probably already have statistics on their maintenance program. Even small companies do things like preventative maintenance, you could obviously make that better, but it's really hard to beat the cost of an google sheets spreadsheet on a free google drive account.

Big airlines might be able to torture some reasonable analytics out of their maintenance data, but I would be willing to bet that most airlines already have something like that. As for seeing specific defects, that's an area of somewhat active research:


This paper tries to use a UAV to inspect an airplane. It's cool, and it could probably benefit from more modern CV tools... but also, I do not think flying a bunch of autonomous quad copters around the airport immediately adjacent to running turbofan engines is a recipe for success. The paper is kind of cool if it could be automated, but if I were a business, I would never implement this on my fleet - or at least until the tooling got a LOT better.
Thank you!
Of course.
 
That sounds fascinating! AI-based aircraft inspection technology could revolutionize how we ensure aircraft safety and maintenance. It could potentially improve efficiency, accuracy, and safety standards in the aviation industry. Do you have specific statistics or data on the effectiveness of such technology?

AI-augmented systems in aviation, such as autopilots and flight management systems, are already widely used and have contributed to improved safety and efficiency in air travel.

Integrating AI further into piloting could offer benefits such as enhanced navigation, real-time decision support, and automated systems for managing complex flight tasks. However, it's crucial to ensure that any AI systems used in piloting are thoroughly tested, reliable, and capable of handling various scenarios, including emergencies.

Ultimately, the acceptance and adoption of AI-augmented systems in piloting will depend on factors such as regulatory approval, pilot training, and industry trust in the technology's capabilities.

CHATGPT DETECTED! (Though he didn't say delve 800 times, so...?)

I’m like 90% certain that I see what you did here.

I'm the other 110%.

No human writes like that
 
What does that even mean? AI augmented system for what? Navigation? Flight path control? Weather avoidance? Optimal bathroom break scheduling?

That seems like a little bit of a vague research or use case request.
I wanted to post the link to the survey, but was not sure if I am allowed to post any external links. Anyway, initially it is about Visual aircraft traffic detection, using computer vision technology. I would appreciate your help with the surveys below. Thank you!

AI-Augmented flight


and also about using computer vision technology in order to detect any defects on the aircraft fuselage in an automated way.


AI in Aircraft Inspection and Maintenance


1715360785801.png
 
bsolutely, but it would have to be "good" in a way that most of the LLMs currently aren't. For the time being the only models I'd be willing to trust until they were tested aggressively would be simple rule based models, and decision tree type classifiers. I would absolutely not be comfortable using neural netw
I'm not sure what a "deformite" is - but, most companies probably already have statistics on their maintenance program. Even small companies do things like preventative maintenance, you could obviously make that better, but it's really hard to beat the cost of an google sheets spreadsheet on a free google drive account.

Big airlines might be able to torture some reasonable analytics out of their maintenance data, but I would be willing to bet that most airlines already have something like that. As for seeing specific defects, that's an area of somewhat active research:

https://www.researchgate.net/publication/331779808_UAV-based_Inspection_of_Airplane_Exterior_Screws_with_Computer_Vision
This paper tries to use a UAV to inspect an airplane. It's cool, and it could probably benefit from more modern CV tools... but also, I do not think flying a bunch of autonomous quad copters around the airport immediately adjacent to running turbofan engines is a recipe for success. The paper is kind of cool if it could be automated, but if I were a business, I would never implement this on my fleet - or at least until the tooling got a LOT better.
Thank you for such a great insight!!!

The organization is AI in actiune We are an "Artificial Intelligence in Action" NGO, the most significant AI community from Moldova that counts more than 1200 programmers and AI&ML enthusiasts. Our community has more than 5 years and during this period we organized meet-ups, workshops, community projects, and hackathons.
 
I wanted to post the link to the survey, but was not sure if I am allowed to post any external links. Anyway, initially it is about Visual aircraft traffic detection, using computer vision technology. I would appreciate your help with the surveys below. Thank you!

AI-Augmented flight


and also about using computer vision technology in order to detect any defects on the aircraft fuselage in an automated way.


AI in Aircraft Inspection and Maintenance


View attachment 77837

That was a helpful explanation. Thank you.

From a commercial airline use point of view, the only question that wasn't particularly pertinent was the cost model. Anything that makes it to the actual application stage would have to be built into approved or OEM hardware/software.
 
A large number of potentially serious defects I've found were almost always noticed when working on or inspecting a completely different system or part of an airplane. Something about how human brains and eyes interact allows us to notice oddities in our peripheral vision that actually register and attract attention. AI might be good at certain specific tasks, if I were to say robots can't change an engine on an airplane I'd be proven wrong by some video of a robot doing it in a perfect, fully prepared hangar at the robot manufacturer. Airplanes have a horrible habit of breaking when they're out on the road, I used to make a living traveling to wherever an airplane was to either maintain and repair or remove and install engines and oftentimes the conditions were less than ideal. Our computers are getting smarter and they can do some things faster and better, but they pale in comparison to a smart human when it comes to the majority of living. Can they program intuition or feelings? I'm just a dumb mechanic...
 
Last edited:
I would, however, be curious how AI handles non yes/no/left/right/stop/go questions.

Like flight planning from point A to point B with unexpected enroute weather and a diversion to a non-listed alternate.

Would the human and algorithm come up with very similar or very different conclusions? If so, why. If NOT.... why.
 
I would, however, be curious how AI handles non yes/no/left/right/stop/go questions.

Like flight planning from point A to point B with unexpected enroute weather and a diversion to a non-listed alternate.

Would the human and algorithm come up with very similar or very different conclusions? If so, why. If NOT.... why.
That's why we rule the planet (I'm still unsure about ownership, but that's a different discussion), we have evolved to adapt and overcome in the moment. There are predators that will eat you and your lunch given the chance, but our ancestors literally beat them back with sticks and stones and ate them and their lunch. Those folks had no choice, it was live or die and their brains shifted into fight or flight instantly but they wanted to protect and feed their family and tribe so they beat back the predators and ate their food. In the grand scope of time that was not that long ago and the obvious next step was for us to start killing each other and it's 2024 and here we are...
 
Thank you for such a great insight!!!

The organization is AI in actiune We are an "Artificial Intelligence in Action" NGO, the most significant AI community from Moldova that counts more than 1200 programmers and AI&ML enthusiasts. Our community has more than 5 years and during this period we organized meet-ups, workshops, community projects, and hackathons.
Cool cool! Thanks for the context, this is awesome and it assuages my concerns when you first posted! I'm happy to help out however I can, send me a private message. I don't speak Romanian, sorry, but I can adapt.
Like flight planning from point A to point B with unexpected enroute weather and a diversion to a non-listed alternate.
You're looking for this old paper:

there's several others I read about during my research into some other stuff:


there was one from ERAU I read that I thought was pretty good, but I can't find it now, they basically converted the route into a grid, and used A* to navigate around the obstacles in real time.
Would the human and algorithm come up with very similar or very different conclusions? If so, why. If NOT.... why.
As long as it's not a neural network, you're probably "ok" - I hesitate to use NNs for anything safety sensitive.
 
Back
Top