Using readers and writers to extract and load data.
Recently active
Hello, I read CSAR raster files with the FME reader for this type of file but when I look at the layers, only one numeric value is given for each pixel in the contributor layer (see red circle in attachment). If the CSAR file is opened in CARIS, three metadata values are available: feature ID (which is a character), start and end date of the measurement. Am I missing a step to be able to read this information in FME ? Thank you!Kind regards, Yasmin
I am running checks on data. Any fails in checks, they will be written to a tab in the spreadsheet. If there are no fails, the tab won't be created. In the case of failures, is there a way for me to print a message to say "Checks ok" into a new tab?
Hello, I tried to make a workbench that write ifc from our data base (building).When i try to read the final file, FME cannot because of syntax error for the ISO10303-21 format. Each building has one ".." value that cause the problem.#35=IFCBUILDING('O6Hu3fDbRB2OEJH5wcfNLw',#23,'51_102','','',#34,$,'51_102',..,$,$,$); If i change the ".." by a $ (that mean 'Null' according to BuildingSmart) the file is fine and FME is ok to read it. Does someone know what parameter or attribut I missed in my workbench that cause the ".." ? Thanks !
Hi! I have encountered some difficulties as I am trying to check whether certain microstation files contains empty levels. I've studied the feature-reader for Microstation datasets, but I cannot find a way to read empty levels but only levels that has content within. My hypothesis is that the feature reader outputs all the levels that is associated with a feature, and hence, misses the empty layers.For Autocad files, I had the same issue initially. However that was solved by using a Schema (Any Format) - reader on the Autocad-file dataset and hence reading all the layers as fme-feature-types. Any ideas?
Hi guys, I am still learning FME and have made a few workspaces which are working well for me however I am doing a merge with a SQL non spatial and a mapinfo tab file and am trying to make an end result of the poly's having no fill or patterns, just an outline and being transparent. I have tried many things, the closest I have gotten is creating the attribute mapinfo brush transparent and setting to True, and if I create a pattern with Mapinfo styler the transparency works - obviously with the pattern though, I have tried doing an attribute expose and remove for the mapinfo_brush_background and foreground. Sorry I have been trying to do this for a couple of hours and tried all sorts of combos but just can't get it. Thanks in advance Garry
"" Error connecting to PostgreSQL database(host=, port=, dbname=, user='postgres', password=): 'could not connect to server: Connection timed out (0x0000274C/10060) "" How do I get FMe server to connect to my PostgreSQL db stable every time ?
The input-data are in e57-formate and we want to split them up into a huge amount of small pnts-files for using them in Cesium JS.We need a tileset.json-file for each pnts-file. There should be an overall tileset.json-file in an superior folder listing all children tileset.json-files. Each generated file (pnts and tileset.jsons) should not exceed a specific file size (e.g. 2 MB). We are using version FME 2023.0. Our workbench has an e57-point-cloud-reader, a PointCloudExpressionEvaluator, a PointCloudSplitter and a Cesium-point-cloud writer. The data are splitted by the attribute set in the PointCloudSplitter. How is it possible to get multilevel tileset.jsons? We already created an superior tileset.json-file and many pnts-files. The problem in this case is the big size of the generated tileset.json. In another case many tileset.json- and pnts-file-doublets. The problem in this case is the missing tileset.json-entry-file.
Does anyone know of a way to use FME to generate a .lyrx file with symbology that I could then use in ArcGIS Pro? I think a lyrx file is just XML under the hood? Making and remaking layers in ArcGIS Pro is a pretty huge pain point for me, and I'd love to see someone make a transformer / writer to help with this, so that I can just specify a data source, specify symbology parameters and click 'Run' in FME to generate this > add to ArcGIS Pro, instead of using ArcGIS Pro's laggy interface to click around in the symbology pane. @mark2atsafe thought you might know of a solution? Thank you
I've downloaded a geopackage file from Data Map Wales (in the UK) containing listed buildings and whenever I load it into FME Desktop it seems to miss a field containing a date, all the other fields are there. I've used DB Browser for SQLite to read the file and the missing field is definitely in there and contains data. In FME Desktop I've tried using a reader and a featurereader to load the file, both approaches fail to recognise this field. I've also tried in QGIS and the field does not load in there either. I initially thought that the data might be malformed in some way but the fact that it reads fine in DB Browser for SQLite suggests otherwise. Does anybody have any ideas as to how I can read this date field? The data is available from this website Listed Buildings | DataMapWales (gov.wales)
I need to create a summary slide with multiple sections/placeholder tables on one slide, so I need to have my font size to be 10pt for example. So far it seems that FME hard codes the table font to 18pt. Thanks, Joey
I want to reproject DWG files with Pipe Network features from UTM Zone 17 NAD83 (Original) to MTM 10 NAD83 CSRS using ON83CSv1.gsb.when I use ArcGIS data interoperability and EsriReprojector, it reproject all feature except Pipe Network features.is there any sollution for it?
Hello,I am experiencing difficulties reading an Oracle Spatial table with FME.The table (linestring) has about 250K records.FME starts to log the first 10000 records after about 10 minutes. And then 10000 at a time every 6 minutes.The table is displayed in GeoMedia and also QGis in about 5 minutes.Feature Caching is disabled.I have tried both with the reader and with a SqlCreator. Same results.What checks/configurations can I try?This is the first time it happens and not sure if some metadata could be wrong or corrupted.This sounds strange because of the tests with other products.TIARoberto
Has anyone encountered issues with 4-band jp2000 files written by FME Server crashing in Kakadu? The error is:"A `jp2_channels' object indicates the presence of " "more colour channels than the number which is associated with the " "specified colour space. This may happen while reading a JP2-family " "data source which contains an illegal channel definitions (cdef) " "box, or it may happen while writing a JP2-family file if the " "`jp2_channels' object has been incorrectly initialized."
I have a logfile I need to extract some info from but I'm not sure what to use. Here's an example of what I have.<Msg time="2023-06-05T19:55:23,511" type="INFO" code="9029" source="Rest" process="35236" thread="1" methodName=""
What would be the most convenient technique for querying data stored on Azure Data Explorer (ADX) from FME Workbench? Should this be done via a HTTPCaller?
Hi All,I'm trying to update MDB_ADO reader in existing workspace - it's new data delivery with the same structure as the previous one. I'm getting "An error occurred while updating the reader". I tried also open some random tables in blank workspace, and I was able to do it, but after ran workspace I got "Error running translation" or FME has been closed "automatically".At first I tried to do it in FME 2022.1.1.0 (64 bit), MS Office is 64-bit as well.Then I installed the newest version of FME 2022.2.5.0 - at first everything worked fine - I updated mdb reader and I was able to run the whole workspace. When I closed FME and opened it again I wasn't able to update reader or open any other random tables in blank workspace - so same errors like in older FME version.I tried clean all temp files, I created new temp folder, I tried to repair mdb via "Compact and Repair function in AccessDB. After all of these changes I was able again to work
I would like to be able to use FME to bulk upload data to salesforce. We currently manually upload csv files with awareness that there is a limit of 50,000 rows per file (salesforce import wizard). I have seen it should be possible to automate this using the salesforce reader/writer. I have the API credentials for salesforce and I can see all the table objects available in FME. The issue is that the object we are trying to write to appears to have different fields than expected when read (these look to be metadata fields) - see image. When we run the process to manually import using the wizard the attributes are those in the csv uploaded (see image). Both of these tables are the custom table 'property(_c)', the saleforce URL indicates that this is the case. Do you need to change permissions on the object salesforce side or do anything specific with the reader/writer in FME to get this working? Kind regards, Antony
I am trying to connect to my Smallworld 5 database with FME 2022. I can connect successfully with 2021. I have FME Smallworld edition and have copied the needed connection files to the installation folder. What have changed between the two versions? It says 'This FME edition does not recognize the 'SWORLDSWAF' reader.
I would like a PRJ file written alongside the DWG when using a dynamic format workflow. The bespoke AutoCAD writer has a setting, just looking for how to do with with a dynamic workflow.
Hi When working with full Desktop FME it is possible to set where the log file is written to disk through the GUI (or set it to be a parameter), however when working with the ArcGIS Data Interoperability Extension version setting the log file location is not available in the GUI (none of the workspace parameters are). Is it still possible to set where the log file should be written to on disk through a variable or is this functionality removed for a reason? Ideally, I would like to write the log file to sit alongside the data being processed. ArcGIS Desktop 10.5 which uses FME 2016 Many thanks Duncan
I have an FME workspace in which input from an DWG file is read and exported into an FGBD file. I am using a dynamic FeatureWriter. For the layers, this has the following result: If there is a layer named 'xyz', and this layer contains e.g. text, line, and point features, the FGDB writer will create three layers 'xyz_text', 'xyz_line', and 'xyz_point' for the features. Is there any possibility to tell the FGDB writer to group the layers such that in e.g. ArcGIS Pro, all the layers 'xyz_text', 'xyz_line', and 'xyz_point' are already grouped below a parent layer/group layer 'xyz'? Or is this something which necessarily has to be achieved by another tool, e.g. using ArcPy?
Hi,I read an Oracle Database with "esri SDE" connection file. I need to update the reader. We now have a new Oracle table that contain a new column and the datatype of that column is "xmltype". With a Oracle Reader or SQLExecutor, I can read the "xmltype" data. But if I read the data with "SDE", the column is not there. Like SDE don't understand "xmltype". Any idea ?
I want to be able to read a list of PDFs from SharePoint and publish them on AGOL as PDF.
In QGIS I can open Google Street View coverage using this URL as XYZ tile:https://mts2.google.com/mapslt?lyrs%3Dsvv%26x%3D{x}%26y%3D{y}%26z%3D{z}%26w%3D256%26h%3D256%26hl%3Den&style%3D40,18 The result is following: I can't get it to read into FME Desktop. Any suggestions?
This may be a little simple but it seems not to work for me, I have a workspace that reads a .csv file and runs a process. Ideally i would like to move this csv file once the process is complete and rename it by date. What i have tried so far,After the reader i created a junction and I put one process to run through the whole workspace and another arrow i put to a DateTime stamper, DateTimeConverter and created the attributes filecopy_source_dataset, filecopy_dest_dataset and filecopy_dest_filename, (based on several tutorials i have been reading.) I then use the filecopy writer to move the file. The file gets moved but the name is not changed and i get a warning that --> Ignoring the destination filename .. because the source dataset...was not a file. Destination file names are only used when the source dataset is a file. For some reason the exact name i did set (@Value(Datum)_@Value(filecopy_dest_filename)) is shown in the written summary but not on the folder, anyone with an ide