Using readers and writers to extract and load data.
Recently active
Hi there! I am new into the FME world and I am kinda hoping somebody can point me into the right direction. Currently I am trying to build an FME routine that will allow me to read metadata from a excel sheet (preferred format from the engineer department) and write it into a geodatabase feature class.This is how my workflow currently looks: Everything seems to work fine when it comes to updating the metadata fields (Title, Summary, Description, etc.) but when it comes to writing new values (writing in a blank field) the routine runs successfully but no values are being added to the feature class metadata. This is how my XML Updater looks: In this particular instance the feature class has a title so the FME routine is updating to the new title located in the Excel spreadsheet. That being said the Summary and the Credits metadata fields are empty in the original feature class and remain empty after the process is completed. I already tried all different Update
Hi there, I am a new user to FME and therefore not so familiar with the interface and functionalities of FME desktop. I downloaded the software as I read in some articles that you could translate Cadastral property data and building height data into Minecraft with the help of FME. I am currently working on a project in Minecraft where the aims are to build the whole earth with human structure into the game. Even though the project has 100,000 users already participating, it is simply impossible to recreate everything by hand. If it is possible to load entire cities into Minecraft, it would help a lot. I would like to know which data I need, how I should utilize it in FME, and how the conversion process works to recreate the shells of buildings in Minecraft. Thanks in advance!
I am in the process of converting one of our large workspaces that looked at the saved extents of an ArcGIS Map (.MXD) file and using a CAD seed file, wrote out an AutoCAD .DWG file. The old/original workspace wrote data out to specific layers in that CAD file. It also applied labeling, blocks w/rotations, etc... The end result was a decent looking CAD .dwg that our designers could use as a starting point for a new design project.My goal is to transition this to an FME Server App and make it a multi-purpose process that would use the Generic Writer and would allow users to select an extent within the FME Server App map and export to the same type of a CAD file, but also if needed, export out a KML, or other formats.What's the best way to accomplish this? (Writing features out to specific layers withing the CAD .dwg)
After updating to FME 2019.1, I've found that the GoogleGeocoder transformer no longer works. I've been attempting to use the Geocoder transformer, but it seems that a lot of the attributes that were returned with the GoogleGeocoder are no longer returned with the Geocoder. This is causing issues with existing workbenches that rely on those attributes.Has anyone else encountered this? Is there a workaround for the Geocoder transformer to have it return all of the original fields, or has anyone been able to fix the GoogleGeocoder to work with FME 2019.1? It was suggested to use regrex to parse the individual fields, however since addresses aren't standardized it wouldn't be feasible to do so.
Hello!I found a way to configure a JDBC connection using env variable but unfortunately, it breaks another software configuration I have on the same Windows machine. My goal is to set the following configuration: JAVA_TOOL_OPTIONS=-Djava.security.auth.login.config=...I felt like it was possible to directly configure the attached JRE (like in jre\\lib\\security\\java.security file) but it doesn't seam to work. Since I am running the fmeworkbench.exe, how can I pass the configuration to the program? Is there a config file which is read (seams to be the case for the server)?Many thanks for helping and wish you a great day!Christophe
HiThis is a problem which has bugged me for years. I cannot work out how to set the feature type as a published parameter in a FeatureReader transformer that is reading in a Microstation DGN file. I have a number of different combinations of the following settings and none seem to work. All I get is one record coming out of the Initiator Port and the DGN file data does not come out of any of the ports. Can anyone help me with this?I am on FME Desktop 2019.1.Thanks!
This service used to read just fine, but now throws the following error: "Failed to obtain any schemas from reader 'ARCGISFEATURES' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more informationFailed to read schema features from dataset 'https://apps.fs.usda.gov/arcx/rest/services/EDW/EDW_FireOccurrence_01/MapServer' using the 'ARCGISFEATURES' readerThe dataset 'https://apps.fs.usda.gov/arcx/rest/services/EDW/EDW_FireOccurrence_01/MapServer' was closed successfully" The strange thing is, this service reads just fine with a regular Reader, but I need to use a FeatureReader so that I can read in a bounding box through the initiator. It looks like the error occurs when setting the "Feature Types to Read" parameter.The service is public, so hopefully you can take a look and see what's happening. I am experiencing the issue in FME
Hello,I have a excel with al lot of sheets per region (500 different names). All have the same form.On each sheet in different rows, I have measurements for each day. (Timestamp : 365 d)The name is in the sheet (yellow) and also in the sheetname (tab).Now I want a table where for each day, I have a new colomn per region. Example for 3 regions is attached, also how the result should look like.Thanks for any tip!
@virtualcitymatt
Hello, I am struggling with reading Excel files into my workbench. I built my workbench based on an Excel file with this format. When adding the reader I set the 'field names row' at 3, so the names in row 3 are used as column headers in FME. I want to use my workbench for other files as well. These files have the same format. Only the information from row 4 will be different. So I created two user parameters witin my workbench:- Input File- Output Directory If I open my workbench and run the translation I can fill in the user parameters: When I choose the original file which I used to create the workbench, all goes well. But when I choose another file, I only get missing values:I even made a copy of the original file, so it is exactly the same document with only a different file name. But even then I get missing values. Can anyone explain to me what I need to change in my settings to overcome this?Has the red indication in the User Parameters window something to do with it?
Hi Guys I don't know if i should open a new task but i do so now. I have 2 short answers Reader: dwgmy output dwg should be rotated (another north direction) and scaled to 1:1000are there format attributes for that or have i handle this with Transformer (Scaler,....) thx and GreetzFranco
Okay newbie here (sorry in advance)--so I plopped an MSSQL reader into my workspace and set the max count for each feature paramater to read to 10. And indeed, the cache count stops at 10. However, in the log I can see that it is still going to town on 4 million spatial records in the SQL DB and the bucket keeps filling up even after it reaches the max 10 count. In other words, setting the max features to 10, 100, or 1,000,000 takes exactly the same amount of time (and resources) for the workspace to complete its processing. What am I doing wrong here? THANKS!
Hi there,I am fairly new to FME so please go easy!I'm looking to do the following task, broken down into the following steps:Search through a folder to locate shapefiles (all line primitives)Set some criteria to filter which shapefiles I want to keepMerge & Dissolve the shapefilesWrite the output to a geodatabaseFor Step 1 I believe I need to use the 'Directory and File Pathnames' reader, with a *.shp path filter.For Step 4 I understand I need an Esri Geodatabase writer. For the rest, I am a bit lost...How do I then inspect what FME has found in Step 1?What are some useful transformers I could use at each step?
Dear all, I am currently working on a project where I assess watershed areas upstream of several ditches. The area is a polder area (no significant internal differences in elevation) with flow direction somehow incorporated into the ESRI shapefile (see arrows in below figure), no clue how. In the end, all ditches lead to the red star. I have aready calculated the watershed area for each individual ditch. The next step would be to somehow add a column in my shapefile where all upstream watershed area's are added together to find the 'total watershed area' that provides the water flowing through the ditches.Some things to note: - Some ditches split into 2 other ditches. These, we assume, both get 50% of the water that flows from the upstream 'parent' ditch - Dark blue lines and lighter blue lines are major- and minor channels/ditches, and can be regarded as similar in function - Arrows show the direction of flow in all ditches - Since the area is a flat polder, elevat
I'm trying to extract attributes from the attached json string using a jsonextractor. I thought the jsonquery field would be json["datetime"] but nothing is being returned. Any help is gratefully received. ThanksN
when I view the drawing in map3d the cs is listed. When i view the dwg with arccatalog i can see the same CS. however when i add it to workbench it is not being recognized.I am trying to set up a dynamic workbench to re project coordinates dependent upon the cs of the reader being used. Is there a way to get the autocad cs and set that to a published parameter?
Hi all, I'm working with FME Desktop 2019.2 and I have encountered a problem with the FeatureWriter. I need to save features in a CSV file and I want to use FeatureWriter settings to manage escape char and to qualify field values only if needed. Below the settings used.The problem is that FeatureWriter doesn't qualify a string value like the following:- Lorem ipsum dolor "sit amet"While it works correctly with a string like the following:- "Lorem ipsum" dolor sit ametThe CSV file created by FeatureWriter using the two string above is:"Test_2","Test_1""""Lorem ipsum"" dolor sit amet",Lorem ipsum dolor "sit amet"
Hi All. I am working on fme workbench to convert json data from api into Arcgis online feature service. Actually i am quite new on this software.reader/ data link: https://covid19-public.digitalservice.id/api/v1/wilayah/jabar?level=kelurahanHowever, when i run, and export it as ArcgisOnline feature service the data on the arcgis online is empty its actually consist more than 5000features.feature service link: https://services6.arcgis.com/eV2M5wbf5ix69NmC/arcgis/rest/services/datajson22/FeatureServerand the one that makes me more confuse is when i export the data into file geodatabase format, i could see the all data. here the image: overall workflow on fme workbench: attached:fme workbench could anyone share what is the main problem from this or how can i solve this.Thankyou in advance
Hi,I would like to add a new row containing some descriptive information from a seperate stream above header row in an excel spreadsheet.ThanksDavid McDermott
Hi there, I am writing the output of FME translation in csv file using csv writer. However, I noticed that file does not show up in the selected folder. I tried to change the configuration of the CSV writer. But no luck. Couldn't anyone tell me where am I making the mistake? The attached file shows the parameter of CSV writer.
I'm using an ArcGIS Server Feature Service Reader to read in flood hazard polygons but it keeps timing out, returning zero features. There are no errors or warnings in the log and the workspace keeps running after the reader times out. There are about 3 million features in the entire dataset (for the United States). I only need two states (New Mexico and Texas) but even clipping to a search envelope on the reader makes no difference. It's a publicly available service, no login required. What can I do to successfully read in the features from this service?
First of all sry for my bad english! ;) I like to recreate the osm scheme out of our own scheme with FME Desktop We'v got lines transformed with the keys:boundary=administrativeadmin_level=3-8 and combined lines with the keys:osm_relation_type=boundarytype=boundaryboundary=administrativename=*admin_level=3-8 My Problem is the FME osm-writer creates his own geometries without the line-tags but i'd like to get my own created lines as a member of the Relations.
Hey everybody,recently I'm getting into converting 2d autocad plans into a simplified 3d model. So far I'm able to create a model. Now i have checked the tutorial of @daveatsafe in converting a dwg to ifc with rooms but I'm still having a question.How do I write the autocad layer property to an ifc file that I use in BIM dwg. Because at this moment whatever I'm trying I'm getting all the entities on layer 0.Thanks in advance,Andreas
Hi there!Do you know why the File Copy writer doesn't log an error when the source file doesn't exist?It only logs an warning:File Copy Writer: Ignoring the destination filename '<file>' because the source dataset '<path\to\file>' was not a file.It was problematic in my case because I monitore only the errors in the log files... :/Thanks in advance for your feedback,Rémi
Hi everyone, I'm trying to create polygons with arcs (airspace) from aixm 4.5 data. I found this extremely useful workspace from @takashi i here: https://knowledge.safe.com/questions/56273/how-to-create-a-good-geometry-with-coordinates-xy.htmlbut I'm having troubles with the pythoncaller to create arcs. While it works pretty well on some data subset (ead_identifier contains _EI) for others I get a "math domain error"(ead_identifier contains _EG) and I can't figure out why.Any help would be appreciated