Using readers and writers to extract and load data.
Recently active
I've taken some Workspaces created in 2015/2016 and saved them as 2017.0.1.1 Workspaces. I've removed Readers and Writers and added them in fresh. In some cases I get this report in the log:Workbench: Workspace integrity check during load found one or more readers/writers with configuration issues.Workbench: Backed up current workspace as: E:\\AddressBase\\Plus\\FME\\LACHS (backup).fmwWorkbench: Fixed reader/writer configuration issues.I know this means the issues should be fixed, but it raised the question in my mind about the best way to upgrade Workspaces. I know old ones should generally run in a later version of FME but in these cases I'm changing the Reader(s) and/or Writer(s) so I might as well update the Workspace version.Some Workspaces have a lot of transformers in, so is a good upgrade path to create a blank Workspace, add the Reader(s) and Writer(s) then copy and paste the transformers from the old Workspace (then upgrade transformers and edit parameters if n
When I looked at the below linkhttps://knowledge.safe.com/articles/48316/importing-into-smallworld.html I came across the options "Export to FME" and "Import from FME" in Folders dialogue boxDoes anyone used these options (refer image at red polygon)??? If yes could you kindly provide some information about uses/functions/requirements to use themThank youPratap
I have receive field application and harvest maps (.dat) from Climate FieldView. I am quite certain these are raster images and they don't appear to be compatible with any of the existing FME formats. I believe they may be of the same format used by SST Summit, MapShots AgStudio, SSI Agvance Mapping, AgIntegrated. Does anyone have experience with reading these files?Ideally, we would like to get them into a format where we could show them as historical reference files (GeoTiff, etc.) within an app that is currently using WKT and MySQL Spatial.
@mark2atsafe I can see Lookup type was added for 2019.1, is calculated there too?
Hey,I'm using the new Autodesk Revit Reader to import a Revit model. It imports all the objects, but a lot of the used attributes are missing. Also some of the objects, mainly objects of the Architectural.GenericModels have no geometry (which should be solids). I already tried to expose the missing attributes, but I had no luck doing this. Are their any options to get the missing attributes and geometries or do I have to wait for a more developed version of the Autodesk Revit reader?Thank you in Advance!
Hello, In my case there a a feature reader, then some tranformators for removing some attributes and adjusting fanout expression and then gml writer. Why fme saves some partial results to ffs even if there is a lot of free memory? I think that it takes a lot of time causing performance impact. part of log:2019-05-28 12:07:33|1909.9| 0.0|STATS |Storing feature(s) to FME feature store file `C:\Temp\2\no-conn-ffs-1559036060497_7200_14.ffs'2019-05-28 12:10:00|2055.8|145.9|STATS |Stored 1009731 feature(s) to FME feature store file `C:\Temp\2\no-conn-ffs-1559036060497_7200_14.ffs'
Hi I am trying to bring in an XML table from http://envdata.es.govt.nz/services/data.ashx?f=water-level.xml which has some useful water level data. I have tried different XML readers and can't get it to read the data. Can someone recommend a workflow that will read it.
hello every oneMy name is Maher I am student at University of Oulu FinlandNow I am Working on modeling 3D City Model using FME .I am using GML File and Laser Scanning data .I used a workflow and I got good result .However the roofs of All building are considered as a flat surface and the details of the roofs are not taken on consideration 'Because of that I would like to Ask you if you can help Me to construct the full Building with Its roof detailsLas data is in the LINKMy Previous Result LINK
I am manipulating a Google Sheet by inserting many rows of data via a Google Script triggered by my FME Workbench. What I wish to do is to read the Google Sheet all over again once all the insertion have been completed. I couldn't think of a way to do this except by pausing the whole workbench while the insertions are being donne. Is there a more time-efficient way of achieving the same result?
I have a fairly large *.xlsx Excel file (27 MB), when I attempt to open this in an FME Desktop reader, upon selecting the "parameters" button or pressing "OK" the application crashes.If I re save the file as a *.xls file, this removes data and re-saving as an xlsx file doesn't achieve anything either.Any Ideas?
I am a new FME user and am trying to extract a text information from a PDF. Reading this fórum I came up with this: Using attribute filter I choose the page number I need to extract that information and the inspector showed me this:The yellow text is the information I need to extract. How do I do extract that to a excel file or csv?
This problem: " Unable to use format 'Smallworld 4/5'. Format is not supported on this platform (WIN64). Smallworld reader/writer has unmet dependencies. Please contact Smallworld to obtain the Smallworld reader/writer plug-in (Smallworld Translators Suite DVD). Please contact http://www.safe.com/support if you require additional assistance. " how do I solve this problem
This article says "Note: When translating from DGN to DGN where a complex chain in the source data set has custom line styles, then you have to set the keyword PROPAGATE_CHAIN_ELEMENT_LINKAGES to true to translate the custom line styles properly to the destination format. " What/Where is the Propagate_Chain_Element_Linkages keyword?
I'm using a dynamic workspace with generic writer to create output files in the format that the user selects. When the user chooses to export as ESRI shapefile I would like it to also build the spatial indexes for the output shapefile. I can get it to write the shapefiles just fine but they don't have spatial indexes. Is this possible with the generic writer by setting it in the schema feature somehow? Or would I have to specifically use the shapefile writer which has it as an option?
Hi there,I'm having trouble reading a Sharepoint Online list using FME 2017.0 - I was able to do this in FME 2016, but would like to use 2017 so I can also use the CSV2 reader..The error seems to be something to do with SSL verification. The username and password are definitely correct because this exact same reader works in 2016.Thanks, error message below:Microsoft SharePoint List Reader: SSL certificate verification failed for host 'XXXX.sharepoint.com'. HTTPS connections may not be secure. Disabling verification of SSL certificates. Message: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:590)Microsoft SharePoint List Reader: Error authenticating via SAML. Verify that the username and password are correct, and that this is a SharePoint Online instance. Response message was: ''A fatal error has occurred. Check the logfile above for detailsFailed to obtain any schemas from reader 'SHAREPOINT' from 1 datasets. This may be due to invalid datasets or format accessibil
I'm looking for anyone else who might have experienced something similar. I have come back into the office on Monday to find that the FTPWatcher on the FME Cloud has just detected all of the files on our FTP server as newly created....which caused a lot of workspaces to run.... I suspect something must have happened to the FTP Server itself, however, I can't see anything which might have happened. When looking at the files using Filezilla all of the dates and times of the files seem correct.There is this snippet from the ftpwathch.log which seems to be right before all of the new triggered. There is no timestamp on it, unfortunately.it.sauronsoftware.ftp4j.FTPException [code=550, message= Data channel timed out.] at it.sauronsoftware.ftp4j.FTPClient.list(FTPClient.java:2169) at it.sauronsoftware.ftp4j.FTPClient.list(FTPClient.java:2273) at COM.safe.fmeserver.relay.plugin.ftpwatch.FTPWatchPollingThread.retrieveFileInfoRecursively(FTPWatchPollingThread.java:342) at COM.safe.fmeserver.re
As an example above, I have 2 files with different attributes as headers like Year numbers.The excel reader reads file 1 with years but If I use the same reader for file 2 then it does recognise the non matching attributes and its values. How can I read the attributes dynamically irrespective of which excel file I am reading. Any help is greatly appreciated.
I'm using file copy writer to copy gdb from source location to destination. I'm using file copy writer for this. One of the parameters in this writer is Error on invalid destination which I have set it to NO. So, this means that, if there is no valid destination location found, FME should proceed further without terminating the translation (This is according to the documentation). But, this doesn't happen. So, how can I handle the error and proceed further with the translation without terminating it. Could anyone provide some suggestion on this?
Dear Support team, We are trying to import Autocad(.Dwg) file data into Smallworld database by using FME. In FME if we read the DWG file it is not showing attribute data present in source file. If we open DWG file in Autocade the attributes are visible as in image. f we try to open same DWG file in FME workbench. Attributes list is not coming for maping with target database(Smallworld).DWG file in FME Workbench:We request you to please provide steps to read Autocade DWG file by using FME.
Hello,Trying to setup a process to parse and load IIS log files to a database to monitor errors on a Geocortex site.I have a workspace that returns the file path of the most recent log file and that is passed into a FeatureReader with the CSV reader.The data is space delimited. The issue is that the field name header has one extra field (X). So when the text file is parsed, the field names are offset one column to the right. Header: X |1|2|3|4|5 Data: 1|2|3|4|5|I need to remove X in the Field name header, and shift the header one cell to the left.Ideally this could be done in the CSV reader, but I don't see how.Thanks for the help. Much appreciated.-R
I am trying to read data from an ArcGIS Server Feature Service and am running into an issue with FME accepting the token. When I enter the Service URL into the parameters dialog, put the token in the token field and then test the connection by clicking the button to view the layers list I get an error that tells me it's an invalid token.To access the feature service I have to log into a website using a username and password. From there I have to cut a token to connect to allow FME to authenticate to the ArcGIS Server service. I have no way of validating that the token I generated is correct but I followed the steps outlined in the following ESRI support document so I assume it is correct: http://server.arcgis.com/en/server/10.3/administer...The one suspicious piece of the puzzle is that my token seems to be truncated somewhat. Maybe its standard but each token I've generated ends in "..". This just does not seem right and I was hoping that maybe someone has experience
ESRI has a Runtime Geodatabase used by Collector for ArcGIS. The file has a .geodatabase extension when downloaded from an iPad or Android tablet. In reality it is a SQLite database. I can query it with SQLite Studio 3.0.6, but not read it with FME 2018.1.
I have a shape file with feature class polygon and want to convert them into an osm file. I've verified the polygons by several transformers in workspace. The result is always an osm file with lines instead of polygons (FME Inspector)???
I am designing a workflow that will streamline our our 911 data to ESRI ArcPortal as well as a local geodatabase. the information fed in is from a SQL server and represents specific apparatus information as related to a particular call, and runs through some calculations for things like response time, time on call, etc.. I've gotten to the point where the data splits off in 2 streams one for apparatus data and another for unique call data compiled by merging apparatus information and aggregating the data by the Call Report number. Everything works fine to this point.The initial run of this yielded over 600,000 features to be written since a dataset of call information didn't exist prior this was expected. This initial dataset was then uploaded to our portal service since the Portal writer appears to only insert, update or delete. I run the script daily to pull the previous days call information and when it got to the point that the data was going to be pushed to our portal I g
I know that there is a writer that writes, updates or replaces data in availible layers. Is it possible to write multipatch also? Second question; is it possible to create new layers in AGOL from FME?