Question

Sort data scattered over excel spreadsheet.

  • 23 March 2022
  • 5 replies
  • 4 views

Hi everyone,

we have hundreds of excel-files that we would like to read in and format with fme.

But the data is scattered over one spreadsheet each. like this:

grafikWe would now like to sort this data so that it is in order in a row.

grafikIs this possible with FME? If so how.

 

Thanks for your help


5 replies

Userlevel 6
Badge +32

Is the pattern always the same? I would try with a FeatureReader, type Generic, expose col_0 to col_5, use an AttributeExploder, AttributeCreator and Aggregator to rearrange. If you add a sample file I will give it a try.

Userlevel 5
Badge +25

I just have one question:

 

Who would do such a thing? 😲

I just have one question:

 

Who would do such a thing? 😲

Good question,

 

it's really bad. It is over 20 years old geotechnical lab data that has been stored differently over time in xls files.

 

We are aware that this means a lot of manual work.

The question is can we do it with FME or do we use Python?

 

The goal is to prepare the data so that it can be written into our new database.

 

If you want to have a look at our data interface, here is the web address:

 

https://baugrund-daten.baw.de/

 

Don't worry the address is ok. We are a government agency (Federal Waterways Engineering and Research Institute - https://www.baw.de).

 

Greetings from Germany

Eberhard

Is the pattern always the same? I would try with a FeatureReader, type Generic, expose col_0 to col_5, use an AttributeExploder, AttributeCreator and Aggregator to rearrange. If you add a sample file I will give it a try.

Thanks for the hint, we will try it.

 

The pattern differs 😪

 

it's really bad. It is over 20 years old geotechnical lab data that has been stored differently over time in xls files.

 

We are aware that this means a lot of manual work.

The question is can we do it with FME or do we use Python?

 

The goal is to prepare the data so that it can be written into our new database.

 

If you want to have a look at our data interface, here is the web address:

 

https://baugrund-daten.baw.de/

 

Don't worry the address is ok. We are a government agency (Federal Waterways Engineering and Research Institute - https://www.baw.de).

 

Greetings from Germany

Eberhard

 

Userlevel 6
Badge +32

Thanks for the hint, we will try it.

 

The pattern differs 😪

 

it's really bad. It is over 20 years old geotechnical lab data that has been stored differently over time in xls files.

 

We are aware that this means a lot of manual work.

The question is can we do it with FME or do we use Python?

 

The goal is to prepare the data so that it can be written into our new database.

 

If you want to have a look at our data interface, here is the web address:

 

https://baugrund-daten.baw.de/

 

Don't worry the address is ok. We are a government agency (Federal Waterways Engineering and Research Institute - https://www.baw.de).

 

Greetings from Germany

Eberhard

 

I still think it is doable but you will have to write out what the logic is to get from the source to the result. Hard to say without the logic but I don't think the tool (FME or Python) makes a difference, but getting the logic to the workflow is.

Reply