Using readers and writers to extract and load data.
Recently active
I am working on a FME script that is pulling from a raster in a map service: https://maps.nccs.nasa.gov/server/rest/services/global_landslide_catalog/landslide_susceptibility/MapServer When I do so using a Esri ArcGIS Server Feature Service I get a unsupported error. How can I get the raster into a workbench to do spatial queries against? Thank you in Advance!
Has anyone found that FME unprotects excel worksheets when it writes to them? I have a worksheet that I need to keep protected with certain cells being written to only. The rest of the sheet has loads of complex formulae which need to be kept protected.I have protected the sheet but when FME writes it unprotects it without the password. Does anyone know how I can stop FME from unprotecting the worksheet?
I have created an excel reader with the merged feature type because the source dataset as well as feature type (sheet name) changes with each run. But when I am using merged feature types, I cannot get the .formatting. THey are all coming over as "missing". I would have to specify a specific feature type (sheet name), but because it changes each time (not named Sheet 1), I cannot specify that at creation time.Is there not a way to do this? Am I missing something?
Hello everyone,I am currently trying to get a list of existing file names inside a folder. Here are some explanations :- I have a Path reader which reads existing files in a folder (let's call it folder 1). In this folder, there should be one text file;- If the text file exists, I use a FeatureReader to read it. This text file contains several paths to other directories (folders 2, 3, …, n).- Once I extracted those new path, I want to do the same as with the reader : get the names of the existing files inside folders 2,...,n. For now, I know how to read files from within the Workbench, with a FeatureReader. But how can I do the exact same thing as the Path reader without using one ? I do not need to read the files right away, I just want to get the names of the files Inside folders 2,...,n. The idea is to do all those operations in the same fmw script.Any idea ?
I'm running a workspace with a creator→hhtpcaller and I would like to have the response saved into a new csv (excel) file as a regular table format. This is the API as reference: https://datos.cdmx.gob.mx/api/records/1.0/search/?dataset=casos-asociados-a-covid-19&q=&rows=10000&facet=fecha_actualizacion&facet=id_registro&facet=origen&facet=sector&facet=entidad_um&facet=sexo&facet=entidad_nac&facet=entidad_res&facet=municipio_res&facet=tipo_paciente&facet=fecha_ingreso&facet=fecha_def&facet=edad&facet=nacionalidad&facet=embarazo&facet=habla_lengua_indi&facet=diabetes&facet=epoc&facet=asma&facet=inmusupr&facet=hipertension&facet=cardiovascular&facet=obesidad&facet=renal_cronica&facet=tabaquismo&facet=negativo&facet=migrante&facet=pais_nacionalidad&facet=rango_edad&facet=positivo&facet=pendiente&refine.entidad_res=GUANAJUATO Do you guys know what can I do?
The WFS reader automatically chooses the default srs of a WFS layer. Is there any way to make it read the features in a different srs which is supplied by the WFS supplier (and so also listed as option in the WFS capabilities). Changing the coordinate system of the reader doesn't work. It will still request the features in the WFS default srs and then interpret it (wrongly) as the coordinate system set at reader level.
I am attempting to read photos from attachment tables in a FGDB and write them to an Access DB, where we have a workflow for report generation. I can get the photos out easily enough and write them to a folder, but I can't find the proper settings in the Access writer to add the photos.
Hello,my problem is to style a simple Excel table.When cell xy is 1 --> colour background set to red.It is working in many cases only the first row doesn't turn red. What am I doing wrong?Result in Excel: Thanks for your help. :)
After running a feature service reader or writer a bunch of information is logged such as:ArcGIS Online Feature Service Writer: Getting item with ID '2b51386cf7b346d59fda3ff653deccc3'ArcGIS Online Feature Service Writer: Requesting metadata for Feature Service at 'https://services5.arcgis.com/7X0RdDUh866P5Y57/arcgis/rest/services/FeatureServiceName/FeatureServer' Is there anyway to get the item ID and URL of the feature service as attributes to use in FME? I want to be able to get the URL of the feature service that has just been written to, so I can then do another web request, but I don't seem to be able to get those attributes from the writer?
HelloI would really appreciate it if someone could assist me in resolving the below issue as soon as.My AD account shifted to a different OU yesterday and as a result the canonical object name has changed. I can no longer login however the scheduled jobs are still running. I must investigate 2 failed jobs but can't do so anymore.I came across the following: https://knowledge.safe.com/idea/75118/fme-server-active-directory-away-from-distinguishe.html and wonder if that could be related. Sync AD did not work. Checked logs and nothing obvious found.I've moved my AD user account back to the original OU and I can now login but my user account must be shifted back to the new OU. I think what I'll need to do now is to re-assign the jobs to a different "owner" to avoid the above issue. The new "owner" will be a ServiceAccount type.Questions: Is there a way to manually amend DN / CN Names? How to re-assign all jobs to a new "Owner"? I'm planning on
My goal is to read log files from Amazon 33 and parse them into a databaseThe log files look like this:-#Version: 1.0#Fields: date time x-edge-location sc-bytes c-ip cs-method cs(Host) cs-uri-stem sc-status cs(Referer) cs(User-Agent) cs-uri-query cs(Cookie) x-edge-result-type x-edge-request-id x-host-header cs-protocol cs-bytes time-taken x-forwarded-for ssl-protocol ssl-cipher x-edge-response-result-type cs-protocol-version fle-status fle-encrypted-fields c-port time-to-first-byte x-edge-detailed-result-type sc-content-type sc-content-len sc-range-start sc-range-end2020-07-03 13:39:54 LHR62-C3 1571 148.00.00.00 GET d36on651kzt577.cloudfront.net / 200 https://URL/2020/07/02/fooo/ Mozilla/5.0%20(Windows%20NT%2010.0;%20Win64;%20x64)%20AppleWebKit/537.36%20(KHTML,%20like%20Gecko)%20Chrome/83.0.4103.116%20Safari/537.36 - - Hit gIanUGtmvquSunAiRJFbhFdPbexwpIV2DbtYUJ7XtVOKZopkUl1uEw== foo.com https 427 0.001 - TLSv1.2 ECDHE-RSA-AES128-GCM-SHA256 Hit HTTP/2.0 - - 58606 0.001 Hit text/html;%20
I am complete novice to FME. I have a .txt file which I wish to convert to excel. But I only want some of the information to be brought into the excel spreadsheet. I'm not sure how to begin. All I want in the excel spreadsheet (bottom image) is the name e.g HP40 but without the .tif extension and the date e.g 04/03/2016 without the time.I am not sure what connectors to use or how to strip out the unwanted info from the .txt file.
HI EVERYONE. I AM LOOKING TO CONSTITUTE A GEOREFERENTIATED ENERGY DATABASE STARTING FROM REVIT. I AM NEW TO THE THEME, AND I HOPE YOU CAN HELP ME. IF I AM NOT WRONG, I have to CONVERT THE REVIT OR IFC FILE (VERY SIMPLE GEOMETRY) IN CITYGML AND THEN ADD ENERGY DATA WITH ADE? After this, on which tool can I see the mapped information? are there any tutorials to do it or some examples?Thank you very much for your help
Hi,To connect one collection to my mongodb database (20 collections) it takes 13 min.When i try with another database (4 collection) this is faster (10 seconds).Have you got an idea to accelerate time connexion ?ThanksBest regards
I want to produce 3d citygml road model (textured). I have road line data as shapefile and lidar data of the region (both aerial and terrestrial) and also orthophoto (10cm res). Is it possible to produce 3D citygml road data with these data using FME possibilities? Thank you.
Hi all, does anyone have experience in using the filecopy/mover object.I have created a photo exiff extraction to o tab file workspace. what I would like to do its once its processed it moves it to a new location.I have no idea how to place the object, does anyone have an example of doing something similar> Dave
I want to write files with scheduled workspace on fme server to a Linux server using SSH. I think i have to use python. Does somebody have experience.
I can preview data with Inspector in workbench. After I wrote the data out as a GML file based on XSD schema, I looked at the GML file in the FME Data Inspector. But it appears that there is no Geometry in this View. What is the reason? Is there an error with setting parameters for writing GML files?Can anyone help me?
Hi,Have multiple text files that need to be converted to a csv file.The source text file contains three lines per object, which must be merged into 1 line. (number of objects is unknown in advance)Example,100:00:00,000 --> 00:00:01,000F/6.3, SS 1000, ISO 100, EV -0.3, RTK (4.672639, 52.794202, 28), HOME (4.671729, 52.794208, 43.55m) 200:00:01,000 --> 00:00:02,000F/6.3, SS 1000, ISO 100, EV -0.3, RTK (4.672639, 52.794203, 28), HOME (4.671729, 52.794208, 43.55m) The result should be according to this example.Time,F,S,Iso,Ev,RTK.Longitude,RTK.Latitude,GPS,Home.Longitude,Home.Latitude,Home.Elevation.m,00:00:00.000,6.3,1000,100,-0.3,4.672639,52.794202,28,4.671729,52.794208,43.5500:00:01.000,6.3,1000,100,-0.3,4.672639,52.794203,28,4.671729,52.794208,43.55 Who can help me with that, if only to merge 3 lines into 1 line in a loop.Gerard
GOOD MORNING. I AM AN ITALIAN PHD STUDENT. I WOULD LIKE TO CLOSE MY THESIS INVETIGING THE INTEGRATION BETWEEN BIM AND GIS. I HAVE DISCOVERED THIS PLATFORM NOW. TIME FOR MY SEARCH IS VERY NARROW. THE TUTORIALS I FOUND ARE FROM 2013or2015, IS THERE SOMETHING MORE UPDATED THAT I CAN CONSULT TO ACCELERATE THE EXPERIENCE?
Hello fellas,I've been trying out the new Revit reader and convert it to IFC similar to what Autodesk Revit could do. Nonetheless, the FME Quick Translator could not handle the translation. Is there a quick and "plug and play" workbench for this matter? I have tried setting up the workbench but creating multiple IFC sub-classes (e.g. IfcWall, IfcBuildingStorey, etc) but the result is not ideal. The converted data stored in a table instead of 2D/3D?I m looking for a solution to export IFC and CityGML from Revit in one workbench/ one source. Appreciate it.
Hello,I was wondering if there is a way to import an attachment from MS Access 2010 record to ESRI geodatabase using FME 2015. Thanks.Samir
Dear all, i have question about looping. I have script, which is getting information from database - based on one parameter "_Powerline". I'd like to loop through several values of this parameter and have many ouputs in one script. is it possible? With custom transformer? I don't have experience with this stuff. Thanks in advance for help.
Hello!I have been pulling photos down from ArcGIS Online and have used the RasterReplacer to JPEG writer workflow to do this. I now need to pdf the images.Can I do this straight from the raster replacer or is it better to start a whole new workflow converting JPEG to PDF. Thanks
Hi I'm new to FME and have discovered this program and its capabilities. I was wondering if it is possible to create a georeferenced 3D mesh based on 1 or several heightmaps that are geotiffs that have been created in ArcGIS.