Using readers and writers to extract and load data.
Recently active
I have a SDE Geodatabase with over 1000 featureclasses. I am wanting to select 30 of these and copy over to a Geodatabase. I am selecting these featureclasses by there name. What transformer do I need ? is it Tester ?
Hi,I'm a bit new to FME so pardon me if the question is basic: I use FME Workbench 2018.1. I have a PostGIS table with 1035 polygon features which needs to be updated (Table A). The update source is a WFS layer with 27 polygon features, among which 26 are updated features and 1 new feature to be added to Table A.The workflow is as follows:1. Since the WFS has a different schema to Table A, I use AttributeManager to make the WFS attribute table consistent with Table A. 2. I use Tester to filter out the 1009 features that don't need to be updated.3. I write the filtered 1009 features and the 27 updated/new features from WFS to Table A, hoping to get an updated layer with 1036 features. I have the following feature type settings:-Table A has a column 'gdb_geomattr_data' which seems to store geometry, so I set the Spatial Column of the writer as 'gdb_geomattr_data'-Table definition set to 'Automatic'-Create Generic Spatial Columns: No-Bulk Insert: No-Table n
EDIT: After doing steps below I now am able to update the LOCATION field but no new records are being being added when I run the FME job. Any ideas?I'm attempting to automate reading an Oracle database and writing to a Socrata dataset using FME workbench 2018. Everything was working except that every time I ran the job I had to manually set the lat/long columns in Socrata to get the map working.I googled the issue and found this documentation: https://support.socrata.com/hc/en-us/articles/207040527-Working-with-Point-Data-Using-the-FME-Socrata-WriterThen I did the following:I used attribute creator to create a new field called LOCATION that concatenates the latitude and longitude columns so that the values look like “POINT (-87.61694 41.70737)”. This location field is already setup in Socrata as a point geocoded column.I have attached a screenshot of my workbench and the new Location field below.When I run the workbench it gives me an error, and although the LOCATION field is popul
I just would like to convert CityGML files to json files. When checking the converted json file in the FME Data Inspector, I get the errors shown below. Maybe I missed some parameters during reading/writing. Thank you for your help!These errors are shown when checking the json file:CITYJSON reader: An error occurred. FME will attempt to provide more information on the error, but this may cause the translation to be terminatedRead Metadata Feature Command caught exception: stk::ex::FatalError[0] CITYJSON reader: [json.exception.parse_error.101] parse error at line 1, column 2: syntax error while parsing value - unexpected end of input; expected '[', '{', or a literal[1] auto __cdecl STFReader::openDataSet::<lambda_45ec89e6ecf0932b901acf3bedceb848>::operator ()(void) const(C:\\code\\fme\\foundation\\framework\\engine\\reader.cpp:80) My initial CityGML file:
Hello,I have the following situationI made a drop_down list (User Parameters) - Choise, from which to choose a specific locality.depending on the name of the locality, I generate an excel file.I want that when I create the excel file, this file should bear the name of the locality.Ex: BACAU => BACAU.xlsx AGAS => AGAS.xslx
Hi,I am sending 2600 features to a PostGIS FeatureWriter. When I look in the resulting table (which was completely empty) I see 2628 rows. How is this possible?I noticed it because first I had a primary key defined and I was sure there were no duplicates in the 2600 features, but I got an primart key violation error After removing the primary key I see several duplicates.Any ideas on how to solve this? Or did I find a bug?
Running a simple script of point cloud to Las in FME 2020 desktop. My input is five .e57 files. The script fails after writing the first Las file with the error message: E57 reader: E57 reader: An error occurred while reading. The error was 'checksum mismatch, file is corrupted (E57_ERROR_BAD_CHECKSUM)' with context 'fileName=C:\\1-Working\\GDB\\E57\\1-01-C-01_200219-0.e57 computedChecksum=10167370 storedChecksum=2581601340 page=2465744 length=4044457984' (error code = 16)FFS writer: Failed to get block of 10000 points starting at index 167600000Stored 1 feature(s) to FME feature store file `C:\\Users\\Employee\\AppData\\Local\\Temp\\wb-cache-e572las-IwHIxO\\Main_point_cloud -1 2 -1 0 5593c33571a1202057291a33f5c5400df0f2e01f.ffsupdating'Saving spatial index into file 'C:\\Users\\Employee\\AppData\\Local\\Temp\\wb-cache-e572las-IwHIxO\\Main_point_cloud -1 2 -1 0 5593c33571a1202057291a33f5c5400df0f2e01f.fsi'Finished saving spatial index into file 'C:\
How do I set up my data to generate a stacked bar chart? For each CURRENT_OPERATOR_ALIAS category, I have 7 bins (RATE_CLASS) that I'd like to chart, where one bar is a CURRENT_OPERATOR_ALIAS with corresponding counts (COUNT(API) attribute), but I can't seem to plot 2 categories in the PowerPointStyler.
Hi, I want to clip WMS layer using polygon shp and write it out as a pdf. Any ideas?
Hello, I'm reading data from an ORA database wicht contains - a surname: Çad?rc? - a name: ËCadõrcõ In the inspector I see these names correct with encoded utf-8when I write this information to an (different) ORA-database with Varchar2(800) the table contains: - a surname: Çadrc (wrong) - a name: ËCadõrcõWhen I put the writer items to AUTOMATIC it will give also the same outputWhen I change the TYPE in the writer from Varchar2 to NCHAR the table will contain: - a surname: Çad?rc (wrong) - a name: ËCadõrcõ what am I doing wrong and how to correct this problem?
Hey, I have two tables in the ArcGIS Online space, one contains a list of houses (property_table), and the other related table contains a list of residents that reside within (resident_table).What I am trying to do is populate the property table with the AGE of the OLDEST RESIDENT inside each house. I have no idea how to do this and am seeking assistance to build a plan of attack. I have been able to add the two readers to my workspace successfully, I can do a feature joiner which proves the residents do reside within the said houses. But I don't think its actually necessary for the join for the calculation to take place.So can someone please tell me how I would find the OLDEST resident, and then insert that date of birth, and name, into the two fields in the property table?I have been staring at this for too long and my brain is not able to straighten out the issue in front of me, it should be rather straightforward :( Property Table:Resident Table:
Hi, We are daily updating a number of PDF's with FME for publication on our website but these files need to have the Document Properties set. Our webcare team won't allow for the pdf's to be published. So far I'm not able to achieve this.There seems to be an option with the format attribute 'pdf_document_info_metadata' but how do I format the properties in my writer?When reading a pdf which has these properties filled in, pdf_document_info_metadata is a feature type. I have tried adding this feature type to my pdf writer with the exact same schema. But no result; empty properties still.Does anyone know if writing the properties is supported and how to achieve it?
I created a workbench that reads oracle database view and writes to socrata dataset. I was trying different settings in the writer and now my socrata dataset is missing 4 columns. Is there anyway to create those columns while writing the data? I'm using FME 2018.
Hi all,I have an excel file, where I need to fill in fields based on previous values. This should happen for 3 fields: total_suspects, total_positive, total_recovered, deaths. But some cells are not filled, they are empty. I need to fill in the previous amount, according to the previous date. Example: total_suspects for day 2020-04-06 3:00 is 19, but for day 2020-04-07, it is empty, so it should be 19. This same situation should continue in all empty fields in the sequence of days. This should happen for the 3 columns informed at the beginning. The problem is that this must happen grouped by name. However, each name set has the same date and different values.Look below, my situation now: Expectation: My file below:I have one sample workspace, with one sorter trasformer and one attribute creator with configuration below: My workspace run very well, but for one location (name) only. My file has many lines, and many different locations (names), and in my output file nothing happens. can
Hi,I'm using a HTTPCaller to connect to an XML api service. Although I can connect and receive XML I can't create attributes from the file. I'm new to XML and don't know how to do this. I tried using an XML reader and successfully extracted the attributes, but then FME 2019.2 keeps crashing after reading the file, or reads the file and then doesn't show the reader in the workbench, so I'm hoping this will be a more robust method. I've tried using an XMLFragmenter to get the attributes, but they aren't showing - I assuming I'm missing a step somewhere. testxml.txt I've attached a test file.Thanks N
Hi there! I am new into the FME world and I am kinda hoping somebody can point me into the right direction. Currently I am trying to build an FME routine that will allow me to read metadata from a excel sheet (preferred format from the engineer department) and write it into a geodatabase feature class.This is how my workflow currently looks: Everything seems to work fine when it comes to updating the metadata fields (Title, Summary, Description, etc.) but when it comes to writing new values (writing in a blank field) the routine runs successfully but no values are being added to the feature class metadata. This is how my XML Updater looks: In this particular instance the feature class has a title so the FME routine is updating to the new title located in the Excel spreadsheet. That being said the Summary and the Credits metadata fields are empty in the original feature class and remain empty after the process is completed. I already tried all different Update
Hi there, I am a new user to FME and therefore not so familiar with the interface and functionalities of FME desktop. I downloaded the software as I read in some articles that you could translate Cadastral property data and building height data into Minecraft with the help of FME. I am currently working on a project in Minecraft where the aims are to build the whole earth with human structure into the game. Even though the project has 100,000 users already participating, it is simply impossible to recreate everything by hand. If it is possible to load entire cities into Minecraft, it would help a lot. I would like to know which data I need, how I should utilize it in FME, and how the conversion process works to recreate the shells of buildings in Minecraft. Thanks in advance!
I am in the process of converting one of our large workspaces that looked at the saved extents of an ArcGIS Map (.MXD) file and using a CAD seed file, wrote out an AutoCAD .DWG file. The old/original workspace wrote data out to specific layers in that CAD file. It also applied labeling, blocks w/rotations, etc... The end result was a decent looking CAD .dwg that our designers could use as a starting point for a new design project.My goal is to transition this to an FME Server App and make it a multi-purpose process that would use the Generic Writer and would allow users to select an extent within the FME Server App map and export to the same type of a CAD file, but also if needed, export out a KML, or other formats.What's the best way to accomplish this? (Writing features out to specific layers withing the CAD .dwg)
After updating to FME 2019.1, I've found that the GoogleGeocoder transformer no longer works. I've been attempting to use the Geocoder transformer, but it seems that a lot of the attributes that were returned with the GoogleGeocoder are no longer returned with the Geocoder. This is causing issues with existing workbenches that rely on those attributes.Has anyone else encountered this? Is there a workaround for the Geocoder transformer to have it return all of the original fields, or has anyone been able to fix the GoogleGeocoder to work with FME 2019.1? It was suggested to use regrex to parse the individual fields, however since addresses aren't standardized it wouldn't be feasible to do so.
Hello!I found a way to configure a JDBC connection using env variable but unfortunately, it breaks another software configuration I have on the same Windows machine. My goal is to set the following configuration: JAVA_TOOL_OPTIONS=-Djava.security.auth.login.config=...I felt like it was possible to directly configure the attached JRE (like in jre\\lib\\security\\java.security file) but it doesn't seam to work. Since I am running the fmeworkbench.exe, how can I pass the configuration to the program? Is there a config file which is read (seams to be the case for the server)?Many thanks for helping and wish you a great day!Christophe
HiThis is a problem which has bugged me for years. I cannot work out how to set the feature type as a published parameter in a FeatureReader transformer that is reading in a Microstation DGN file. I have a number of different combinations of the following settings and none seem to work. All I get is one record coming out of the Initiator Port and the DGN file data does not come out of any of the ports. Can anyone help me with this?I am on FME Desktop 2019.1.Thanks!
This service used to read just fine, but now throws the following error: "Failed to obtain any schemas from reader 'ARCGISFEATURES' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more informationFailed to read schema features from dataset 'https://apps.fs.usda.gov/arcx/rest/services/EDW/EDW_FireOccurrence_01/MapServer' using the 'ARCGISFEATURES' readerThe dataset 'https://apps.fs.usda.gov/arcx/rest/services/EDW/EDW_FireOccurrence_01/MapServer' was closed successfully" The strange thing is, this service reads just fine with a regular Reader, but I need to use a FeatureReader so that I can read in a bounding box through the initiator. It looks like the error occurs when setting the "Feature Types to Read" parameter.The service is public, so hopefully you can take a look and see what's happening. I am experiencing the issue in FME
Hello,I have a excel with al lot of sheets per region (500 different names). All have the same form.On each sheet in different rows, I have measurements for each day. (Timestamp : 365 d)The name is in the sheet (yellow) and also in the sheetname (tab).Now I want a table where for each day, I have a new colomn per region. Example for 3 regions is attached, also how the result should look like.Thanks for any tip!
@virtualcitymatt