Using readers and writers to extract and load data.
Recently active
Wonder if there is a direct way to use a reader or feature reader to read a zipped up fgdb stored on google drive. One options is to use google drive connector to download the fgdb to the local drive. Thanks!
Hi,I am using FME 2017.1 and would like to expose the Microstation DGN V8 attribute called 'Group' circled below in the screen shot (Attribute value is 'D' in this case).I have exposed all the 'Format Attributes' in the DGN Reader and looked through the Reader parameters but cannot find this attribute anywhere.Does anyone know how to do this?Thanks,
Hello FMEers, I have been asked to present to a group of Information Management Specialists on the safe software suite of products. In particular they are interested in how FME compares with the SSIS. SSIS is another ETL tool used within the Microsoft SQL Server environment. Having never used SSIS this is a tall order as my default for any ETL processing has been FME. Is there anybody out there that can give me a few advantages and disadvantages of FME compared to other ETL tools in particular SSIS. Any sort of information will help. Thanks in advance. Cheers, Evan Goodwin
I have a set of building obj and then located them according to their coordinates but observed a problem related to darkness of objs. I need to change material attributes. Which function does it provide the need in FME.My FME Workspace: 1. FME Output:2. obj2gltf Output:
Hello community,I'm storing some shapefiles in a MSSQL Server database. How can I get the SQL script FME used to create the database and populate it from the shapefile ?Thank you
You shouldn't notice anything but lots has changed under the hood.Encryption, private and public… New in FME 2017 is how encryption is used with the database connection file where your connection information is stored.We now encrypt for public access as well as private access. In the past anyone with FME installed could read the connection file as FME contained a global encryption key to access the database connection file. This didn’t give them access to see passwords but they could use the connection information in FME.Now, public access to the connection file is controlled by giving FME access to a public key file. By default this public key is stored in the same location as the database connection file so we do recommend moving that to a secondary location where FME can be pointed to in order to access it. This ensures that if someone locates the connection file they won’t have the key file so they can’t decrypt the information.In regular FME use, any user with the database con
Hi,I cannot write a Sketchup file.I have FME(R) 2018.0.1.1 (20180615 - Build 18312 - WIN64)And the log says:Reprojector: Using transformation `SWEREF99_to_WGS84,Forward(Geocentric,EPSG:1879)' when reprojecting from SWEREF-99-13-30 to SKP_COORDSYS_0Failed to write Sketchup file to 'C:\\Temp//LAS.skp'A fatal error has occurred. Check the logfile above for details... Last line repeated 2 times ...Translation FAILED with 2 error(s) and 0 warning(s) (2505 feature(s) output)FME Session Duration: 3.8 seconds. (CPU: 3.2s user, 0.5s system)END - ProcessID: 236, peak process memory usage: 117140 kB, current process memory usage: 93852 kBA fatal error has occurred. Check the logfile above for detailsProgram TerminatingTranslation FAILED.What to do? Best regards,Jonas
Hi everybody,i have to import smal jpg-files (400-500 kb) with geometry into a postgis bytea column. the process is very slow. for example the time to import 40 images takes 10 minutes. the import with pglobeditor takes 2 seconds. Please help what could be the cause.,
I am very interested to know if FME can take a spread sheet based file and convert it into a 3D CAD model.I work in the water industry and if I had a spread sheet full of manholes and another full of pipes. Could FME plot the manholes based on X and Y's in the spread sheet, it would also have manhole depth, diameter. The pipe spread sheet would the contain its upstream and downstream node, its depth, length and diameter. Everything in theory that it would need to convert to 3D. Is FME able to then take all of this and give me a CAD output?I have seen a video taking GIS buildings to a 3D format by the person telling FME that the height is in Column X of Y spread sheet, I guess this is just a more complex use of the program.
Hi, I have a block model which is an ore bodies geology represented by cuboids. Each cuboid block represents a volume of ground and has a number of numeric (typically grades, densities, or metallurgical parameters) or alphanumeric (rocktype) attributes assigned to it.It's basically a csv file with headers as follows:IJK,XC,YC,ZC,XINC,YINC,ZINC,XMORIG,YMORIG,ZMORIG,NX,NY,NZ,fe_perce,fe_recov,oxide,rescat,sg,mat_type,fillpc,mass_rec,mass_re1,air,al2o3,cao,k2o,loi,mgo,mno,phos,sio2,tio2 I would like to convert this to either paraview VTK format to view, minecraft format, or view it with FME Safe desktop. I am completely new to FME Safe, can you help me achieve this?
I have a simple workflow, read shapefiles, set coordinate system and write to a PostGIS database. I am now trying to write to ArcGIS Online. I have deleted and re-added my connection to AGO two or three times this morning. Each time I am able to authenticate the connection but when I go to add a writer, the Feature Service Loading bar keeps running. I have quit three times after 10 minutes. I was able to write to AGO just a week ago with the same parameters! There is no error in the translation log.
I am trying to change a large KML (4.4million points- 4gb) into SHP format and the output shows the polygons but the attributes are not found. Even in the reader it does not find them, nor in the attribute exposer. I know they are there though as a colleague managed to do in GIS software, my laptop however is not powerful enough to do this method.
Hi all, Apologies for the vague question description, I'm not sure how to formulate my question. When I share my workbench with my colleague the output path of the writer still points to a folder on my computer - so the path has to be changed by my colleague using the workbench.A couple of years ago I managed to write the output to a folder where the workbench was located - regardless if it was on my computer or my colleague's - I forgot how to do this!I remember going from:to something like this:Hope this makes any sense, Cheers, Eduard
Hey guys,I'm struggling with testing a dataset after putting it through an POAOverlayer. I've got a shapefile with buffered points going into the area input and a shapefile of just points going into the point input. The output contains the data that I need with regard to having a clip of points within my areas of interest, but I need to test each individual area (200 of them) against the points within it and can't think of a way for the life of me. I have tried a tester, but unfortunately this tests the whole datasets against each other, at least it did for the test I tried. Any help would be greatly appreciated!
why is filegeodatabase option is not active perhaps i have arcgis desktop installed
Hello,We are trying to migrate postgreSQL DB to MongoDb using FME Desktop. My question is:-1. Is it possible to migrate PostgreSQL to MongoDB alongwith the relation from postgre?2. Is it possible that while migrating first insert in one table and then pass the objectId of that document into another table to maintain the relation?If yes, How can we do it?Thanks
IFC to GDB data conversion Am not able get same names shown in Revit in GDB.Please Find attached image for this problem and help me out..Thanks in advance.
The workspace works in workbench. I am just reading a csv file from a network drive and doing some transformation and outputting another csv file back into the network drive.However when I publish it into fme server and run from there, I received an error "CSV Reader: Failed to read the specified file(s) in the folder '\\\\xxxxxxxxxxxxxxx.csv'"Anyone has any idea?Inside workbench, the destination csv contains the hardcoded network directory.Thanks
I am trying to create separate worksheets using individual Excel writers. I have 40 total. The workbench runs fine, but when I go to open the Excel file I get an Excel error stating "We found a problem with some content. Do you want to recover as much as we can". If I click yes, the file will open, but I lose all of my formatting. All 40 sheets are there, but no formatting on any of them. If I disable the writers for 5 of the sheets, I will not get the Excel error and all of my formatting will be on the 35 sheets. I've tried disabling different writers and combinations of writers, so it's not an individual writer issue. If I try to do 36 sheets or more, I get the same error.
It would be good to have a glossary of terms from a database perspective. FME appears to be good at etl in a non spatial world (or at lest that's my priority at present).There are hundreds of readers/transformers/writers and it appears you can use many to achieve a similar result. Finding the best r/t/w is tricky then not knowing the FME terminology adds to the "interest".Thanks.
Hello everybody,I´m trying to find way, how to write geometry in AIXM in situation, where I have to merge 4 tables to gain geometry. Concretely - I have prepared dataset to write into AIXM format, Vertical Structures feature type. But according to AIXM model settings, I have write geometry into Geometry:ElevatedPoint object, not directly to VerticalStructure object.I checked also the FME demo here: https://knowledge.safe.com/articles/1312/aixm-xml-and-gml-formats-eu-airports-demo.html, but there only one simple relationship between AirportHeliport object and ElevatedPoint. Meanwhile in VerticalStructure issue, I have to trace more objects to write geometry, check here: http://aixm.aero/sites/aixm.aero/files/imce/AIXM511HTML/AIXM/Diagram_VerticalStructures.html?menu=openFrom VerticalStructure feature I have to go to VerticalStructurePart Object, then through VerticalStructurePartGeometry Choice and after then I´m finnaly able to reach Geometry: ElevatedPoint object.Does anybody have ide
Updated:It looks like geometry comparisons are working, but there is a slight difference for how coordinates are stored in AGOL compared to FGDB's; coordinates were off by only a few micrometers. I've had luck using the CoordinateRounder tool and setting the precision to 3 decimal places. Also, instead of using FeatureMerger, I've found that the inputs and outputs of UpdateDetector is a lot more intuitive. The graphic below shows the results as 6 updated features (2 features with attributes modified, 4 with geometry edits), 8 deleted features, 16 new inserted features, and 248 features that were unchanged.------Original Question:------I am trying to update features from a FileGeodatabase (FGDB) to a hosted ArcGIS Online Feature Layer. I'm using @LauraAtSafe tutorial on "How do I write updates to an existing ArcGIS Online feature service?" and I've hit a snag. My results are not showing edited features, and all be the new and deleted features are saying the
I have been given a sample OBJ file by a customer. It fails to load in the object inspector - which just shows a bounding box. In a workbench I get a series of messages like this:Loaded module 'OBJ' from file 'C:\\Program Files\\FME\\plugins/obj/obj.dll'FME API version of module 'OBJ' matches current internal version (3.8 20170315)OBJ Reader: Reverse Face Order: 'No'OBJ Reader: Reading in Variable FeatureType modeOBJ Reader: Opening Dataset: 'C:\\AH_drive\\OneDrive - ESRI (UK) Ltd\\Workspace\\Glasgow3D\\CityModel\\Apr2018\\Carlton_Place_65-67_OBJ_01MAY18.obj'OBJ Reader: Token Unsupported: 'Ni' - IgnoredOBJ Reader: continue reading with next good featureOBJ Reader: Token Unsupported: 'Tf' - IgnoredOBJ Reader: continue reading with next good featureOBJ Reader: Token Unsupported: 'illum' - IgnoredOBJ Reader: continue reading with next good featureOBJ Reader: Token Unsupported: 'Ke' - IgnoredOBJ Reader: continue readin
Hi There, I am working on an issue where our FME workspace, reads data from a database and generates a shapefile. The issue that I am having is that if there are no new records, the shapefile doesn’t get generated but it keeps the last run that had any data. This is creating problem with next step of the process. I am trying to figure out a way so that FME generates a shapefile even if there is no new data (empty shapefile). Appreciate any help. Thanks Jay
Have used a feature merger to merge several excel lists together and want to output them to a single excel worksheet. I've got it working fine except when I run a sorter before the writer, and sort numerically off of one of my numeric fields, the writer will add and additional page to the excel file and put information from one list on the actual intended sheet and information from the other on the additional sheet (if I use an inspector and view the list in Data Inspector it's perfect). If I sort on the exact same field, but do it alphabetically, it puts everything on the single sheet I specify (but of course is not sorted the way I'd like). Any ideas?