Data

The process is to read from a sql database, write to excel file, then import that excel into another software.The software expect one of the fields to be a date field. The data coming out of the database is datetime.I used the DateTimeConverter to go from 20190101000000 to 01/01/2019. I'm using an excel template so I'm setting that field to be of type date. The writer in the workspace is set to be of type date. But the data that is written is text. I can tell it is text because it is left justified instead of right. If I click into the cell and press enter, the data is then right-justified and I'm able to import the excel into the software. I've looked up this issue and the most common solution I found is to do a "Text to Columns" under the Data tab in excel. I did this in the template, but the data written is still a textI thought maybe it was the DateTimeConverter transformer, so I created a view in the database to make it a date instead of a datetime. It is

I have a text file that looks like this:"CommonCode":"EI","IATA":"EI","ICAO":"EIN","CarrierName":"Aer Lingus""CommonCode":"AM","IATA":"AM","ICAO":"AMX","CarrierName":"Aeromexico"I want it to look like this:CommonCode IATA ICAO CarrierName EI EI EIN Aer Lingus AM AM AMX Aeromexico I want it to create the column names dynamically from the text file as the column names will change and increase or decrease in number.In R there appears to be a command called:  “unsparsify”   Which according to this post seems to do it.https://datascience.stackexchange.com/questions/55879/file-format-where-column-names-are-repeated-on-each-rowI can do it using a combination of AttributeSplitters, ListExploders, ListIndexers, AttributePivoters and AttributeExposers.   But I can’t seem to get away from having to Explicitly input the Attribute names in the AttributeExposer and I need it to be dynamic.Any ideas?

When i import OSM.pbf data in FME with the OSMPBF reader the following warning pops up:During translation, some features were read that did not match a reader feature type in the workspace.  This can happen if the reader dataset is changed, or a reader feature type removed or renamed.When i open the data in QGIS, the missing lines are there. Version 2024.2

I am reading an IFC-file using a FeatureReader with the following configurations: I am using the <Generic> port to connect it to a Reprojector-transformer. After reprojecting it, I want to use a FeatureWriter and write it as a new IFC-file. I am however stuck on how I should set up the FeatureWriter. I have managed to get a new IFC-file, but the file size is quite small. I am interested in automating the process, and want the FeatureReader to accept any types of IFC-files. Any tips on how I can solve this?

Hello FME Folks,This is related to MapInfo Tab files. Since we upgraded from FME 2018 to FME 2024.2.1. The MapInfo coordinate System (Non Earth Meters) are not detected which used to happen in FME 2018. Instead it is taking wkt_auto_1 and is misaligned. Please let me know what changed.

LineOnLineOverlayer after upgrade from FME 2020 to FME 2024 output there is a count difference in outputs. The data used for both version is same, In FME 2020 the tolerance parameter was none while there is no such option in 2024, so used 0 as tolerance value. Still showing count difference.

Dear All,I’m  working with two datasets that share a common key: Station ID. Each dataset provides coordinates ( latitude and longitude) for these stations. My objective is to determine whether the station with the same ID have identical location in both datasets or if there are discrepancies.To achieve this, I need to calculate distance between the corresponding coordinates from both datasets. While this seems straightforward, but I encountering challenges in implementing it effectively. I would appreciate any help on the best approach.Thank you in advance.BR//  

Hi, I have a workspace using an ESRI ArcGIS Server Feature Service reader with a token authentication. I am trying to read 3 feature types from the map server and 2 of them read fine but one comes back with the error:  "ArcGIS Feature Service Reader: Encountered an unexpected error. The error code from the server was '500' and the message was: 'Error performing query operation'. Details: ''" Does anyone have any ideas of why only one of the feature types would not work? The three feature services should all have the same naming standards and schema so there is no reason why they should behave differently that I can see. Are there any suggestions for how I might be able to find the source of this issue?  Any help would be greatly appreciated! Thanks.   

I have network based resource folder, that folder si on fme flow When file arrive in that folder, i need to write that file on other location, i just need help i don t know what parameter or what pointer should i send to my reader that it knows which file should write  

Hi,I have a client that is experiencing some odd behavior when it comes to truncating feature classes and tables in a SQL Server SDE environment. The writer is set to 'Yes' for Truncate table however when fme writes out the features heading to the writer it does not truncate the data first but merely inserts data records.If i add a new reader, move the feature types over, configure it exactly the same and rerun the writer functions as expected (Truncate and Load data).Why do i have to add a new reader that is configured exactly the same to get FME to truncate properly. Do FME writers go stale?FME 2015.1SDE (10.4.1)Any help will be apprecaited.

Hello everyone,I was wondering if there is a simple way to filter one Dataset by comparing key-values with another Dataset. Basically a Join but onlky keeping Left Attributes.Example:Dataset1 Project SubID moreAttributes from Dataset1 ABC 1 ... ABC 2 ... DE 1 ... DE 2 ...  Dataset 2: Project SubID different Attributes from Dataset2 ABC 1 ... ABC 1 ... ABC 3 ... ABC 3 ... DE 2 ... FG 3 ...  I want to Filter Dataset 2 to only keep the ABC|1 and DE|2 rows because they match dataset 1. I am sure I could accomplish this via join and subsequently throw out all the Attributes that were introduced from dataset 1, but I was wondering if there is an easier way. Thanks all

Difference in feature count of Neighborhood Finder transformer after upgrading from FME 2020 to 2024. The count differs even though the input data and projection are same. Similarly for lineonlineoverlay transformer the tolerance 0 and automatic gives the same output while the expected was different as FME 2024 does not have an option to give “none” in tolerance.

Hi,I am converting SHP data to DGN using DGNV8 writer dynamically (via FeatureWriter). Everything works fine, but I don´t understand why it always uses ACAD writer first, throws this error and warning:AutoCAD Writer: An error occurred for dataset 'dgn\DI\vydej_di_L1.dgn', in function AutoCAD2004Writer::write. Unknown exception thrown. Aborting methodBADNEWS: ACAD writer: An error has occurred. Check the logfile above for details(D:\code\fme\source\engine\engine_api_impl\cpp\pluginbuilder\dynawch.cpp:129) class StatusInfo __cdecl DynaWriteChannel::putFeature(class STFFeature *&)DESIGN WRITER: Failed to write '3D elements' data through a proxy. Skipping such data for all elements writtenThen it writes everything using DGNV8 writer and the output DGN looks good, nothing seems to be missing. The only issue is that it throws quite big number of errors like this. I publish and use this workbench in FME Flow and the number of errors doesn´t look good in the finished jobs.Any idea how to a

Hi,I have a very basic workbench in FME 2022.2.8Reading features from a MSSQL table and writing to another, it is a FeatureReader/FeatureWriter combon in a dynamic workflow using the schema from the FeatureReader. This is using JDBC MSSQL Spatial.If the geometry column is set to EMPTY the writing fails with the message:MS SQL Server Spatial (JDBC) Writer: Error writing feature. Error: IFMEFeature.exportGeometryToOGCWKB: Unable to export geometry to OGC WKBExamining the feature in the database one can find it using SHAPE.STIsEmpty() = 1 and  SHAPE.STAsText() returns “GEOMETRYCOLLECTION EMPTY”

Hi, It seems there is no easy way to do this from what I have read on this topic. I really wish for a way to extract coded domains from feature classes in an SDE geodatabase.  I don’t even have to have the field names since I have named the domains after the featureclass, subtype and field it is attatched to. How can I get a hold of domain lists within FME? The point for me is to regularly be able to pull out lists of the options my users have in different fields since these need to be looked over now and then.

I have a flat table from a survey that is conducted by clients. I want to aggregate this data at the end of the month and send it to various staff that has had a survey submitted by our clients for their work. I’ve aggregated this data accordingly which produces a list. The aggregated results may differ based on how many surveys get submitted for each staff member that helps our clients. I have also generated a basic email template using the “HTMLReportGenerator” transformer. However, I’m having a hard time iterating through the list populate the HTMLReportGenerator. I’m looking to email each staff member their survey results from the month.Any help or guidance on this matter would be much appreciated. Thanks

I am trying to set up a Web Connection to an OpenID server using the HTTPCaller. According to the documentation there should be an option to set up a new Web Connectionhttps://docs.safe.com/fme/html/FME-Form-Documentation/FME-Transformers/Transformers/httpcaller.htmBut unfortunately I can not find the settings to create new web connections in the HTTPCaller, could someone please point me in the right direction?

Nevermind.I was deceived by a cookie. I was already loged in. Turns out the server required a login form. 

Hello, I am set of 168 pipe segments with Global ID which is failing to write to database when using Esri ArcGIS Portal Feature Service. I am sure that the whole write process is failing due to 1 or 2 pipe segments. In order to debug this, Is it possible to write(commit) each pipe segment one by one to the database and figure out which pipe segment is causing the issue.  Thanks,Naveen

I have a workspace in FME that reads data from a PostGIS database and updates a Feature Service in ArcGIS Online (AGOL). Since the PostGIS data is updated frequently, I use the ChangeDetector transformer to update only the modified features instead of overwriting the entire dataset (to avoid the "413 Request Entity Too Large" error).Currently, each time I run the workspace, I need to enter my AGOL credentials. I want a solution where anyone in my organization can run the workspace, even if the Feature Service is not in their My Content.What are the best ways to handle authentication in FME for AGOL updates?Is there a way to store credentials securely for automation? Can I use API keys or OAuth2 authentication? How do I allow others to update the Feature Service without adding it to their My Content?

I’m trying to upload a raster to Mapbox, but no matter what I do, the output file always turns the nodata cells to black. I have tried fixing this using RasterBandNodataSetter and RasterPaletteResolver. If I look at the feature cached output from those transformers the nodata cells are still transparent. The issue arises when I use the MBTILES writer. No matter what, it writes nodata as black. I also tried removing the nodata (RasterBandNodataRemover), doesn’t work. I have tried outputting the data both as png, png8, and jpeg. Does anyone have any other suggestions? Thank you in advance!

When using a FeatureReader transformer to read Snowflake spatial data, the following warning is posted into the log.Snowflake Spatial Reader: Skipping data in column '.GEOG' due to error (JDBC Type = VARCHAR, Vendor Type Name = GEOGRAPHY, Error: class java.lang.String cannot be cast to class [B (java.lang.String and [B are in module java.base of loader 'bootstrap'))The process does complete normally, but the geometry is not read automatically. Has anyone else encountered a problem like this? I’m using FME Form 2024.0.1.0, Build 24202.

Hi, I have scanned a map and saved it as a raster image. I need to compress this PDF using FME. I have tried RasterMappers and RasterResampler, but both are making my map smaller without actually reducing the file size. Do you have any recommendations, please?

Hi,A colleague and I are working on a script for a client. In the script, we have a simple custom transformer that performs a loop to match some attributes in the correct order. Its basically just a feature merger with a loop: If I run the entire workspace the loops get stuck and keep iterating forever. However if we run the workspace with for example "run to this" far down the stream, it has no problem and the custom transformer finishes after a few seconds.Does anyone have a clue why this is happening and what we could do to prevent it?Best regards

Hi FME Community,I have a folder containing 100 CityJSON files, each with three main features: Building, BuildingPart, and Metadata.I need my files to be dynamically processed by transformers to create new attributes and then output the modified CityJSON files into a new folder while keeping the original filenames.Do you have any tips on how to achieve this?Best regards,ImanePS: I tried using the reader to specify the folder path, but it doesn’t seem to be working perfectly.