Skip to main content
Question

How to read DGN files and work with them in high performance ?

  • January 26, 2023
  • 8 replies
  • 211 views

gogopotter90
Contributor
Forum|alt.badge.img+14

Hello ,

i have around 10 GB DGN files and it takes time to load in FME and and it seems slowly to work with them .

i would like to know , if there is best method to work with DGN files ?

 

Or should I convert them to other format ,if it will be besser then I work with them in new format ?

FME 2021

Thanks in Advance

8 replies

redgeographics
Celebrity
Forum|alt.badge.img+59
  • Celebrity
  • 3699 replies
  • January 26, 2023

10 Gb of any file format is going to take time to process 😅

 

If you can tell us a bit more about what you're trying to do we may be able to give you more detailed advice.


gogopotter90
Contributor
Forum|alt.badge.img+14
  • Author
  • Contributor
  • 239 replies
  • January 27, 2023

10 Gb of any file format is going to take time to process 😅

 

If you can tell us a bit more about what you're trying to do we may be able to give you more detailed advice.

I have my polygons as DGN files , size of folder that contains DGN files around 10 Gb. I would like to find a way to work with them quickly .

i have lots of points as oracle DB and I want to use point on area to find which point locates inside the polygons (DGN files ).

this is my target ,thanks for help .


redgeographics
Celebrity
Forum|alt.badge.img+59
  • Celebrity
  • 3699 replies
  • January 27, 2023

I have my polygons as DGN files , size of folder that contains DGN files around 10 Gb. I would like to find a way to work with them quickly .

i have lots of points as oracle DB and I want to use point on area to find which point locates inside the polygons (DGN files ).

this is my target ,thanks for help .

You could try loading the polygons in Oracle as well and make sure that table is spatially indexed. It's hard to say what the performance gain (if any) would be.


gogopotter90
Contributor
Forum|alt.badge.img+14
  • Author
  • Contributor
  • 239 replies
  • January 27, 2023

I have my polygons as DGN files , size of folder that contains DGN files around 10 Gb. I would like to find a way to work with them quickly .

i have lots of points as oracle DB and I want to use point on area to find which point locates inside the polygons (DGN files ).

this is my target ,thanks for help .

Sry for asking again ,could I load DGN file where fme_feature_type = value or fme_feature_type = another value

so I do not need to load all data in DGN files .is there a method ?


david_r
Celebrity
  • 8391 replies
  • January 27, 2023

I can only confirm that reading DGN files can, in some cases, be relatively slow. I can't say if this is due to the complexity of the format, the libraries FME use for reading them, or both.

If your DGN files are relatively static but you need to read them multiple times, a solution could be to transform then once to the FFS format and then work with those files instead. That should be much faster.


gogopotter90
Contributor
Forum|alt.badge.img+14
  • Author
  • Contributor
  • 239 replies
  • January 27, 2023

Thanks ,I will convert them .


gogopotter90
Contributor
Forum|alt.badge.img+14
  • Author
  • Contributor
  • 239 replies
  • January 27, 2023

I can only confirm that reading DGN files can, in some cases, be relatively slow. I can't say if this is due to the complexity of the format, the libraries FME use for reading them, or both.

If your DGN files are relatively static but you need to read them multiple times, a solution could be to transform then once to the FFS format and then work with those files instead. That should be much faster.

 

@david_r​ 

while I am reading DGN file,could I select specific values from tables ? does it possible ?

i want to use condition ,when FME featur type =value or another value ,read only them and ignore the rest


david_r
Celebrity
  • 8391 replies
  • January 28, 2023

I have my polygons as DGN files , size of folder that contains DGN files around 10 Gb. I would like to find a way to work with them quickly .

i have lots of points as oracle DB and I want to use point on area to find which point locates inside the polygons (DGN files ).

this is my target ,thanks for help .

Unfortunately dgn files do not behave like a database. I believe that FME will end up reading the entire dgn file even if you set a feature type filter. But I'm not quite sure. You'll have to try it out, I think.