Data

I have a logfile I need to extract some info from but I'm not sure what to use. Here's an example of what I have.<Msg time="2023-06-05T19:55:23,511" type="INFO" code="9029" source="Rest" process="35236" thread="1" methodName="" 

What would be the most convenient technique for querying data stored on Azure Data Explorer (ADX) from FME Workbench? Should this be done via a HTTPCaller?

Hi All,I'm trying to update MDB_ADO reader in existing workspace - it's new data delivery with the same structure as the previous one. I'm getting "An error occurred while updating the reader". I tried also open some random tables in blank workspace, and I was able to do it, but after ran workspace I got "Error running translation" or FME has been closed "automatically".At first I tried to do it in FME 2022.1.1.0 (64 bit), MS Office is 64-bit as well.Then I installed the newest version of FME 2022.2.5.0 - at first everything worked fine - I updated mdb reader and I was able to run the whole workspace. When I closed FME and opened it again I wasn't able to update reader or open any other random tables in blank workspace - so same errors like in older FME version.I tried clean all temp files, I created new temp folder, I tried to repair mdb via "Compact and Repair function in AccessDB. After all of these changes I was able again to work

I would like to be able to use FME to bulk upload data to salesforce. We currently manually upload csv files with awareness that there is a limit of 50,000 rows per file (salesforce import wizard). I have seen it should be possible to automate this using the salesforce reader/writer. I have the API credentials for salesforce and I can see all the table objects available in FME. The issue is that the object we are trying to write to appears to have different fields than expected when read (these look to be metadata fields) - see image. When we run the process to manually import using the wizard the attributes are those in the csv uploaded (see image). Both of these tables are the custom table 'property(_c)', the saleforce URL indicates that this is the case. Do you need to change permissions on the object salesforce side or do anything specific with the reader/writer in FME to get this working? Kind regards,  Antony

I am trying to connect to my Smallworld 5 database with FME 2022. I can connect successfully with 2021. I have FME Smallworld edition and have copied the needed connection files to the installation folder. What have changed between the two versions? It says 'This FME edition does not recognize the 'SWORLDSWAF' reader.

I would like a PRJ file written alongside the DWG when using a dynamic format workflow. The bespoke AutoCAD writer has a setting, just looking for how to do with with a dynamic workflow.

Hi When working with full Desktop FME it is possible to set where the log file is written to disk through the GUI (or set it to be a parameter), however when working with the ArcGIS Data Interoperability Extension version setting the log file location is not available in the GUI (none of the workspace parameters are). Is it still possible to set where the log file should be written to on disk through a variable or is this functionality removed for a reason? Ideally, I would like to write the log file to sit alongside the data being processed. ArcGIS Desktop 10.5 which uses FME 2016 Many thanks Duncan

I have an FME workspace in which input from an DWG file is read and exported into an FGBD file. I am using a dynamic FeatureWriter. For the layers, this has the following result: If there is a layer named 'xyz', and this layer contains e.g. text, line, and point features, the FGDB writer will create three layers 'xyz_text', 'xyz_line', and 'xyz_point' for the features. Is there any possibility to tell the FGDB writer to group the layers such that in e.g. ArcGIS Pro, all the layers 'xyz_text', 'xyz_line', and 'xyz_point' are already grouped below a parent layer/group layer 'xyz'? Or is this something which necessarily has to be achieved by another tool, e.g. using ArcPy?

Hi,I read an Oracle Database with "esri SDE" connection file. I need to update the reader. We now have a new Oracle table that contain a new column and the datatype of that column is "xmltype". With a Oracle Reader or SQLExecutor, I can read the "xmltype" data. But if I read the data with "SDE", the column is not there. Like SDE don't understand "xmltype". Any idea ?

I want to be able to read a list of PDFs from SharePoint and publish them on AGOL as PDF.

In QGIS I can open Google Street View coverage using this URL as XYZ tile:https://mts2.google.com/mapslt?lyrs%3Dsvv%26x%3D{x}%26y%3D{y}%26z%3D{z}%26w%3D256%26h%3D256%26hl%3Den&style%3D40,18 The result is following: I can't get it to read into FME Desktop. Any suggestions?

This may be a little simple but it seems not to work for me, I have a workspace that reads a .csv file and runs a process. Ideally i would like to move this csv file once the process is complete and rename it by date. What i have tried so far,After the reader i created a junction and I put one process to run through the whole workspace and another arrow i put to a DateTime stamper, DateTimeConverter and created the attributes filecopy_source_dataset, filecopy_dest_dataset and filecopy_dest_filename, (based on several tutorials i have been reading.) I then use the filecopy writer to move the file. The file gets moved but the name is not changed and i get a warning that --> Ignoring the destination filename .. because the source dataset...was not a file. Destination file names are only used when the source dataset is a file. For some reason the exact name i did set (@Value(Datum)_@Value(filecopy_dest_filename)) is shown in the written summary but not on the folder, anyone with an ide

Hi, I'm using FME workbench 2022.2, Build 22789 - WIN64. I'm trying to process several thousand JP2 files.I'm finding that trying to open just one JP2 file (~1.5GB) in the inspector doesn't seem to work ... by that I mean I stop the process after waiting about 30 minutes.  Thanks in advance for help!

I can set an index on an integer or even a unique index, but there is no type for a primary key or autoincrement. How can I specify this? I could do this with an SQL Create expression. Can I use SQL to create a schema?I am adding a changeset with new records using insert but I need an OID column for ArcGIS to be able to use the table/featureclass separate from the real ID.

I was just wondering if anyone has done sunlight / shading analysis in FME? In Rhino 3d + Grasshopper, Ladybug and Honeybee are plugins that can do this. Below a few images. I know that one can do some interesting stuff with the surface footprint replacer, and change the angles, and thereby create shadows. But thought I would ask before diving deeper. Maybe another option would be to go the ESRI route.  Ladybug:Ladybug Tools | Food4Rhino  CheersFred

FME(R) 2022.2.5.0 (20230329 - Build 22795 - WIN64 Hello Just detected this possible bug when importing Attribute Names / Values using Attribute Manager. The Names are pre-sorted and the "Sorted" option unticked as shown below. Once the dataset has been imported (Select * for Input/Output/Values) the values are set as shown below. Was I not meant to see the actual values or have I misunderstood this part? Looks like the Attribute Names have been set as values. If that's intended then what could be a potential use case?  Original Attribute Names order / Table structure as defined in the Postgis Db ThanksSameer

Hi,I have been investigating this for some time, but did not find any solution so far: In order to read sharepoint lists from a predefined sharepoint site, I used the web connection "Microsoft SharePoint Online (Template)". As testing / reauthentication was successful, I felt ready to read a list from this specific sharepoint page so I inserted its URL and indicated my web connection. However, when I click on "Lists" to retrieve the lists I created, I get an error message (see attached). The error in the log furthermore shows:"Failed to obtain any schemas from reader 'SHAREPOINT' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information" I am using FME 2020.2. Do you know what I am missing here?

In both 2022.2.5 and 2023.0.0, I am unable to read DWG files or DGN files. The translation log reads:DWGAutoCAD Reader: An error occurred for dataset 'xxx.dwg', in function AutoCAD2004Reader::open. Exception thrown: 'Extended error' (The file cannot be accessed by the system. SCENEOE_23.9fme_17.tx) Failed to obtain any schemas from reader 'ACAD' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more information Translation FAILED.Error running translation.Workspace generation failed.  Parameter file was C:\Users\JSDBRO~1\AppData\Local\Temp\FME_1683040838597_37964.DGNFME API version of module 'acad/ACAD' matches current internal version (4.0 20220615) AutoCAD Reader: An error occurred for dataset 'xxx.dgn', in function AutoCAD2004Reader::open. Exception thrown: 'Extended error' (The file cannot be accessed by the system. SCENEOE_23.4fme_16.tx) Translation was SUCCESSFULError running tran

HiI have some wired issueI use the PDFPageFormatter to insert to a template PDF all sort of data, some of it in Hebrew and are numbers.I notice that when I insert a Hebrew Characters, It didn't appear on the PDF.Can someone please help me?Thanks!

I am running a workspace converting DGNs to gdb with no errors but it gets to this message: "FME API version of module 'GEODATABASE_FILE' matches current internal version (3.8 20190621)" and does not proceed anymore any ideas?

Hi.I'm having trouble with a workspace, that outputs a number of GeoTIFF files to a folder.I'm using a FeatureWriter to output the GeoTIFF's. The FW has no option whether to overwrite existing files.When I save the workspace as a mapping file, and run fme.exe with this mapping file, no files gets overwritten, i.e. older versions remain in the output folder.If I run it manually (i.e. the workspace in Workbench), it seems like files are getting overwritten.Is this the WAD behaviour, or is there a difference between running *.fme and *.fmw files ?How come there isn't a setting in FeatureWriter to control this ? Or is there, somewhere hidden ?Cheers.

I am able to write to a local MySQL database, but I would like to write to a remote MySQL database through an ssh connection. I don't see that the Add Database Connection interface allows this. Is there a way to do this?

I have an excel file with lat/long coordinates and I'm trying to create points based on them in a file geodatabase. The geometry is being created but I keep getting an error when trying to view the attribute table: "A column was specified that does not exist." I've checked that all the columns are green in the file gdb writer.​If I replace the file geodatabase writer with a shapefile writer everything works fine. Can anybody tell me how to figure out what is going on? Using FME Workbench (Form now?) 2020.1 Thanks, Mike

Hi all!I would like to write my data to a format called .geo which is used in Sweden but is not supported by FME.I attach some sample how the format looks like:FileHeader "SBG Object Text v2.01","Coordinate Document","UTF-8"begin   FileInfo "Application","Geo Professional"    FileInfo "SerialNo","123456789"   FileInfo "Author","Abcdefghijklmnopqrstuvwxyz"   FileInfo "Company","Abcdefghijklmnopqrstuvwxyz"   FileInfo "Description",    FileInfo "Coordinate System","Sweref 99 18 00 / RH2000"endPointListbegin   Point "123456",6580210.000,155715.000,,,,"rör i mark med däcksel"   Point .....   Point....endLineListAttributeList I have a list with points and want to fill in the list in the "pointlist" section.Would this be possible with FME right now?Any ideas or help is appreciated. 

I have to assign line IDs to bus stops (point on the line). All lines are splitted at junctions. Desired result: S1 IDs: 001, 002 (but not 025)S2 IDs: 003M1: 015, 016 (but not 031)M2: 017 Any thoughts?