Using readers and writers to extract and load data.
Recently active
Hi, good FME people!First post here, let's see if we can solve this.I am using a CSV reader to read all the files within a folder. [...\\rawdata\\*}], regardless of file extension.In the reader parmeter menu I am using the standard dataset parameter, feature type name from file name. I am noticing that not all files are getting through the reader. And by checking all unique fme_feature_types against what is actually in the folder it seems that duplicate filenames a skipped. The problem might be that there are duplicate file names, but in windows explorer, they are not considered duplicates as they have different extensions. Ie "1204NA.SND" and 1204NA.cpt"Is there a good solution for this? Thank you in advanceVictor
The query below works in Dataloader and the Pentaho Kettle tool. But the Salesforce reader ignores the Parcel__r.xx fields. I see where @schatt15 posted here saying he used Dataloader in his SF Reader. But I don't see any option like that in SF reader. I'm using FME Workbench in ESRI 10.7 FME(R) 2019.0.0.0 (20190328 - Build 19238 - WIN32)Thanks for your time.AllanSelect Parcel__r.MUSW__Street_Number__c,Parcel__r.MUSW__Street__c, Parcel__r.MUSW__City__c,Parcel__r.MUSW__State__c,Parcel__r.MUSW__Post_Zip_Code__c,CreatedDate,NAME,Ordinance__c,MUSW__Status__c, MUSW__Corrected_Date__c,GRASS_SQ_FT__C,Age__c,Code_Enforcement_Area__c,Safe_Clean__cFROM MUSW__Violation__cWHERE CreatedDate = LAST_N_DAYS:100
I have a problem with Path Reader in FME Server during Automations. I am quite new in FME Server, so maybe this issue is very easy.I would like to build automation with Directory Watch as Trigger - if file is creating or modyfing Workspace will run. Path to watch: $(FME_SHAREDRESOURCE_DATA)/Input.First part of my script, created in FME Desktop, depends on moving and archiving old data from $(FME_SHAREDRESOURCE_DATA)/Output to $(FME_SHAREDRESOURCE_DATA)/Archive. I built script in FME Workbench, wherein the Reader is PATH, and the Writer is file_copy.When I run this script with using Run Workspace in FME Server, everything is correct, old data are moved and new data are transformed and saved in FME Server Resources.But when I try to run it with Automation, something is wrong and in the log I can find the information:79Path Reader: Error opening the PATH Reader on folder 'Server\\resources\\data\\Output'. Could not find folder.80MULTI_READER(PATH_1): Skipping to next Reader81A fat
Hi!,Can somebody tell me why I'm having a writing problem with GML? I have noticed that they are the only one having the property : Arc by centre pointAny clue to solve this problem? Thanks.
Is there a way to take the data that is in an AutoCAD DWG paperspace and output it to TIFF / GeoTIFF keeping all the drawing settings from the DWG i.e. fonts, line weights etc. Basically I want to get an image that would be the same as if the DWG was printed from AutoCAD.
Hi, I have different DXF File with a lot of layers. I read them with the AutoCad DWG/DXF reader, filter and editing them. For the better handling I read the files as merged featuretypes, but I need at the end the data with single featuretype. That means I need all layers from the file and not the merged.How can I manage this with the Autocad DWG/DXF writer? Thanks and best regard
Greetings,I am writing a workbench in which I am supposed to read from an Arc SDE(oracle) database and writing all the contents in a File GDB. All the attribute names have their aliases in arabic which I need to replicate in the FGDB.I have checked the alias mode of the SDE reader to "Expose Aliases as Metadata" and the reader reads it but somehow it is corrupting the aliases in the output file GDB. Can anybody please help me getting through this. Regards,IMRAN
Thanks for the heads up on that one question, @redgeographics - I think you're right. It's too much to expect anyone to answer with that much content. We'll see how they respond and we can keep an eye out for if they ask that sort of question too often (if they do we'll usually pass it on to their sales contact at Safe to suggest training or paying for consulting with one of our partners)
Hi.We're looking into producing some custom maps for offline usage on an iPad, and is looking at using the ArcGIS Explorer app for this.We do have access to ArcGIS Desktop, and to ArcGIS Online, but I would very much like to use FME to generate the map content.I've already uploaded custom map data to ArcGIS Online with FME, but maps for offline use require some "map package" (MMPK) files to be created and uploaded.Is this doable ? Has anyone attempted such a task with success ?Cheers
Hi,I am trying to build a KMLtour in FME so I can use it in Google earth. However, it is not working as I wish it did. First of all, from 3rd perspective it moves with a blink of an eye to the start position. I would like it to smoothly move to the start position. And secondly, it is "jumping" up and down, back and forth throughout the whole tour. What I really would like the KMLtourbuilder to create is to run it smoothly from start position to end position.Can someone please help me with this task? I will attach all my work in a zipfile and also the kml tour builder that may be open through google earth.
This is what I get when I write to a Spatialite database...: I don't know what's going on.Well it says there is no geometry mapping, but how is that? No geometry mapping entry found for 'fme_varchar(200)' in metafile 'C:\\Program Files\\FME2019\\metafile\\SPATIALITE.fmf'. Please visit http://www.safe.com/supportWorker 11036 > No geometry mapping entry found for 'fme_varchar(200)' in metafile 'C:\\Program Files\\FME2019\\metafile\\SPATIALITE.fmf'. Please visit http://www.safe.com/support
I have a obj file (200MB) and want to convert to cesium 3D tile. The FME converter is just change the format but i would like to apply LOD for the final 3D tile. is there any options in FME to provide tis function?
Howdy,Working with the Excel Writer, I am wondering if there is a way to have a sheet name of 31 characters and a named range of an additional 10-20 characters? A combined 31 characters does not permit very descriptive naming of sheet names/named ranges, if I'm completely missing something or someone has a suggestion for a work around I'd love to hear it. Background The writer’s General Parameters Sheet Name text box is limited to 31 characters, which makes sense since this is the designed maximum length for a sheet name. Reading the FME tutorial "Using a Template File when Writing Excel Data" there is no mention of character limitations.FME's character limitation becomes an issue when writing to a named range, both the sheet name and named range are entered into the the same text box separated by a "/". Due to this, where the combined total characters exceed 31 the extra is trimmed off (e.g. sheet name & named range of "DataSummary_FMEoutput/
Like a poster who previously posted a similar question moving from 2015 -> 2016My WFS reader has suddenly stopped working in 2019 moving from 2016.I get the following error message Sending HTTP 'GET' request to 'http://spatial.bom.gov.au:80/cgi-bin/mapserver/users/bomw0296/wxs?SERVICE=WFS&VERSION=1.1.0&REQUEST=GetFeature&TYPENAME=IDQ65470_wtr_lvl&NAMESPACE=xmlns%28%3Dhttp%3A%2F%2Fwww.opengis.net%2Fwfs%29&MAXFEATURES=1000', waiting for response ...Parsing XML document 'http://spatial.bom.gov.au:80/cgi-bin/mapserver/users/bomw0296/wxs?SERVICE=WFS&VERSION=1.1.0&REQUEST=GetFeature&TYPENAME=IDQ65470_wtr_lvl&NAMESPACE=xmlns%28%3Dhttp%3A%2F%2Fwww.opengis.net%2Fwfs%29&MAXFEATURES=1000'HTTP transfer error: 'Couldn't connect to server'XML Parser error: 'Error in input dataset:'http://spatial.bom.gov.au:80/cgi-bin/mapserver/users/bomw0296/wxs?SERVICE=WFS&VERSION=1.1.0&REQUEST=GetFeature&TYPENAME=IDQ65470_wtr_lvl&NAMESPACE=xmlns%28%3Dhttp%
Hi All,I have installed FME 2017 64 bit and ArcGIS 10.5 64bit geoprocessing tools. I am converting SDO geometry to ST_Geometry. While writing the features I am getting Unable to convert value taken from Z_ORIGIN keyword to a float data type issue. I tried all the possible ways, still no luck. Could any one help on this??
Hello, I'm working with a Excel file from an institution in México. It is a list of people, there is 22 registers.It is like this:#NOMBRE1SANCHEZ HERNANDEZ Pedro Antonio In México, people's name is composed of three parts: Fiirst Name + Father's Last Name (FLN)+Mother's Last Name (MLN). Usually the register in an Excel Spreadsheet is: a column "Nombre" (NAME) then we can read in a row, for instance: "Pedro Antonio SANCHEZ HERNANDEZ". It is not useful for filtering using for instance Last Name.So, I want to split this column and creating two news attributes: Apellido and Nombre. where Apellido will contain the Last Name and Nombre will contain First Name. In the spreadsheet, the string begins with the Last Name = The FLN + MLN, then it comes the First Name, usually is a combination of two first names, eg: Pedro Antonio (Peter Anthony). There is a blank space between all the names.
Want to find an equivilent to autocad_layer_plottable attribute for DGN files to check if a level has plot turned on.
Hello,I am new to JSON formatted strings and have spent a few hours trying to split out some content with JSON Extractors and Fragmenters with no luck. I have an array of 10 "items" which I need splitting into separate features. What I need to pull from each item is the publishedParameters list (as a split list) and WorkspacePath. So they resulting objects should be formatted as such:Item# ¦ WorkspacePath ¦ publishedParameters0 ¦ "APIrepository_prod....." ¦ "name": "user_email", raw: "Glenn.sayers@halliburton.com"0 ¦ "APIrepository_prod....." ¦ "name": "cell_size", raw: ""0 etc.1 ¦ "APIrepository_prod....." ¦ "name": "_layers_other", raw: ""1 ¦ "APIrepository_prod....." ¦ "name": "_layers_gde", raw: "present_nonclipp
Hi everyone, I'm new on FME Desktop.I need to create a kml from excel, with some specific format (see screenshot below)I haven't been able to put the balloon code into KML PropertyFormatter transformation tool. Any help would be appreciated!Please find the example kml file attached.Thanks a lot!
Hi,I have a model where the readers change a lot so I have to update regularly but I have noticed that it does not work through the update reader.The only thing that works is save the fme model, close it and open it again.Am I the only one who bothers that?I'm working with FME(R) 2019.0.0.0 (20190328 - Build 19238 - WIN64)
I need to read secured map services (not feature services) from ArcGIS portal into my workspace. Before upgrading to portal, I was able to use the HTTP caller to access the REST services. Now I'm trying to use the Esri ArcGIS Portal Feature Service reader, which obviously isn't working because they are not feature services. Any ideas on how I might access the secured services? I don't think I can still use the HTTP caller because our access is windows authenticated (NTLM), therefore getting tokens is not an option.
When I'm using the Adobe Geospatial PDF reader it seems to me that the Raster Size parameters are always greyed out and can't be altered. Am I maybe overlooking something, or is this a bug?The following screenshots illustrate the issue. When the parameter 'Read Rasterized Pages' is set to 'No', the Raster Size parameters are greyed out (and also the 'Raster Size' 'group name' is greyed out.)However, when the parameter 'Read Rasterized Pages' is set to 'Yes', the Raster Size parameters are still greyed out (wheras only the 'Raster Size' 'group name' changes to an 'exposed state'.).I'm using FME Desktop Oracle Edition, FME(R) 2019.0.1.0 (20190506 - Build 19253 - WIN32).
Hi allI have a simple IFC file which has just 8 IFCWalls and 2 IFCSpaces. When I run a simple query for retrieving all records for IFCSpace elements ( select * from "public"."IfcSpace"; ) , SQLExecutor duplicates all records. For instance, I have 2 records for IFCSpace but after running the query, I'll get 4 records. How can I avoid duplication? (I use PostGIS)
We're frequently being asked to use authentication providers other than Active Directory for securing and providing access to FME Server, eg. Cognito, Azure AD. Has anyone attempted to use nginx to reverse proxy to FME Server and handle the authentication via SAML? Is there a way to get around the double login (e,g, login to nginx, and then login to FME Server)? Could you create a role that has very limited access (or use a FME Server app with a long expiry token) to get around the double login and provide basic access?User -> nginx reverse proxy (authenticated) -> FME ServerSome more context provided here: https://github.com/safesoftware/fmeserver-nginx @pallegama
When writing to a geopackage, is there a method to add metadata?