Prepar3D for dataset creation

SDK supports Prepar3D’s philosophy of an open development architecture and encourages third parties to bring new innovations with improved add-ons and training content.
Post Reply
EdoCha
Posts: 2
Joined: Wed Nov 15, 2023 7:58 am

Prepar3D for dataset creation

Post by EdoCha »

Hello,

Assuming a use case of automating the creation of datasets for training neural networks for e.g. a vision based Autoland system. With that respect, we would likely want to create a plug-in that:
1. automates the positioning of the camera at different locations and orientation along approach paths to runways all over the world and capture those images together with some ground truth information (e.g. camera position, runway position…) that would be used as expected outputs during the training of the neural nets.
2. automates the variations in terms of weather, day/night mode.
3. maybe can create particular scenario where it positions specific objects on the runway (e.g. a plane, a truck…)
4. Uses the custom post process system advertised in the developer features to simulate lens artifacts (e.g. chromatic aberrations, motion blur, lens dirt/dust, distortion…)
5. Uses the custom post process system to generate segmentation maps of the environment as metadata in addition to the images. As for other metadata, maybe we could project lat/lon coordinates of some known key points into the image (assumes knowing the graphics stack 3D transformations to apply) to get their corresponding image pixel coordinates ? Or is there a better way to retrieve some information about the 3D world like for instance the location of the 4 corners of the runway inside the generated images ?
6. Simulate other kind of sensors than vision based camera (e.g. infrared). I see night vision and infrared is advertised in the tool capabilities. How realistic is this ?

First of all are all those things possible with prepar3D ? Any comments on those ?

Secondly, can you confirm that the Professional Developer License is what we would need to develop and implement the plugin ? Do we then need in addition a professional license to actually run the plugin or not ? If we stop with the developer license once the plugin is developed, can we still run the plugin with a professional license only ?

Thanks,
User avatar
JorgenSA
Posts: 6015
Joined: Sun Mar 11, 2018 7:17 am
Location: 5 NM ENE of EDXF

Re: Prepar3D for dataset creation

Post by JorgenSA »

I can't comment on your first question, but for the second I suggest you send an email to:

licensing@prepar3d.com

Send both questions, the licensing guys may be able to direct your first question to the right people.

Jorgen
System: i5-12600K@4.9 GHz, ASUS ROG STRIX Z690-I motherboard, 32 GB 4800 MHz DDR5 RAM, Gainward RTX 3060 w/ 12 GB DDR6 VRAM, Windows 10 Pro.

All views and opinions expressed here are entirely my own. I am not a Lockheed-Martin employee.
EdoCha
Posts: 2
Joined: Wed Nov 15, 2023 7:58 am

Re: Prepar3D for dataset creation

Post by EdoCha »

Thanks Jorgen, I'll give that a try.
Post Reply