Using readers and writers to extract and load data.
Recently active
I know relatively little about Revit so this may be a noob question. I've got a Revit drawing with features that have an image draped across it, basically signs and what they look like. I can translate the Revit data to geodatabase without issue, but those images don't come across to the multipatch features in ArcGIS. There is no way in Esri to do this programatically (they have a SketchUp workaround) and I was wondering if there was a way to maintain those during the translation?
I have a collection of .zip files (ie. AB_170203, BC_180203) that I would like to move from one drive to another for archiving purposes. I have a tester set up to separate the .zip based on date and now I just need the .zip's to move. Writer ParametersFile Operation:MOVE Copy Source Folder: NoCopy Subfolders: Yes The process will complete but nothing moves.
Dear FME'ersI have a SpatiaLite file, which I can read with the SpatialLite reader in Workbench. However, there is one non-geometrical table, which does not pop up in the Feature Classes.So, I thought, I read this table with the 'SQLite Non-Spatial' Format. I get following error:SQLite 3 Reader: Opening `Z:\\Connector\\GPS2Sirius\\TC_NM_DataFileGPS_V6.sqlite' for read operationSQLITE3 reader: Database query 'PRAGMA table_info("ElementaryGeometries");' failed. SQLite3 Engine error: 'no such module: VirtualElementary'However, in the Data Inspecter, I can open the data with the same reader. Does anyone have an explanation for this? The SpatiaLite database is filled in QGis, but I do not know how it was created initially.
Hello ! I am joining some data with information included in distinct CSV files. For this joining, I use the DatabaseJoiner. As it is quite big CSV files (> 7M entries), the index creation takes some times before actually making the join. However, as the input data are big also, I am processing the joins by tiles, but it means that for each tiles, the DatabaseJoiner is creating its own index again before joining and so on... Is it a parameter or something else to write somewhere this created index so that it only have to read it again to use on the other tiles ? Many thanks ! Nicolas
I have a dataset with a large number of areas (tiles) that border each other. Each area contains a large number of shape files. Each area folder holds the same types of data. All files have unique names.They have the following syntax: area_datatype.shp.I would like to merge all the files of a similar datatype into one. So instead of having X areas with Y shape files in each I would like to have Y shapefiles covering all areas X.The standard procedure is to build a dynamic work space and use fme_feature_type for the output, but I can't get it working this time. My guess is that I somehow need to pull the name of the data table, if that is possible? Or is there some nifty setting that I might have missed?Any advice on how I can get this to work?
Hello! I need to copy the contents of a sheet in a Gsheet format into an xls sheet of an existing file that have others sheets. the operation must overwrite the sheet only by emptying it and repopulating it, but I lose the column names even if I have selected the output field names option. what am I doing wrong?
Hello everybody,I have huge problem - working with SVG format, Im new one in work with this format. I have many questions please, how to figure it out in FME:1.) How could I create body of SVG like this:It means create tags <title>; <defs>; <pattern> etc.2.) How could I put 'elem_type' attribute into <g> quotes (like above)?3.) How could I put text content between <text> quotes without prefix CDATA, check below?My aim is to get line like this: <text stroke=rgb(0,0,0).................................>22.11.1999</text>Please, help me! :-)Thanks, Lubo
In FME Workbench, we can see the "help" of Transformers or Formats when clicking on it. But, it does not work for my part for the custom formats although there is a description inside the custom format : Format Parameters > Description > Help . Is there a specific procedure to follow or maybe it is not possible ?Thank you.
I would like to search by zip and for the Zip Code area would be returned on the map. Please advise, Thanks!
Hello! Ihave a task to convert data from dgn (v8) into any of the vector formats that can be opened by QGis and then converted back. The following conditions must be met:1. Saving tag information, including field names, which can be quite long (in this connection, the shape format is not suitable, when converted in which the column names are cut off).2. Preservation of connections in between the elements of complex objects (cells) with aggregation during the subsequent reverse conversion.If the first condition is satisfied, for example, when using the tab format as output, then there is difficulty with the second one. Our data is looks like this:and this:We have an existing workflow, which is not working properly and can be attached here. But I'm not sure that our way is optimal and want to ask your advice which way of transformation could be best for saving such information?
Hello, I have workspaces runner in my work flow triggering another workbench doing analysis and writhing data in to the geodatabase (Esri Geodatabase (File Geodb Open API) also tried with POSTGIS but still same issue. I am facing slowness processing 2000 records running process more that 2hours then terminated can any one help me to overcome this issue it’s taking so much time.
In MS Access database, the Occurrence table has an XML data type field called “ReportDataXML”. This field contains details/values for all the fields on a particular form for a given record.I need this field transposed to a table for each record in the Occurrence table. The transposed table should have columns for record id and the xml values for each node – see second table for an example of what I’m after. Source data sample – record id = 6, ReportDataXML field extract only for 3 fields.Occurrence table ID field has value:6ReportDataXml field has the following content (exerpt only):<F7183047af02945f1aa4cf819519c1b72 xmlns="http://www.gaelquality.com/Bacchus/OccurrenceFields" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"> <DataType>list-reference</DataType> <Value>3193</Value> <Archived>false</Archived> </F7183047af02945f1aa4cf819519c1b72> <Fa080141ebf5b417999a0b5da90569306 xmlns="http://www.gaelquality
Hi,I was wondering if there is any way to write from an Oracle Spatial Object to Excel, the following attributes:- Column Names- Data Types- Nullable- Triggers- Dependencies- Constraints- Indexes- SQLand so on?Perhaps this is more of a question of knowing in Oracle where these tables are stored? I am using FME desktop 2018.1Thanks,
Running an automated script that gets data from another source to map. Have table in SDE (10.3.1) and set to Insert with Truncate Existing. The table is not truncating. It appears to work with Drop and Create. However, we want to keep the permissions and such intact, therefore using Truncate. This feed started today with about 15 rows, changed to 8 rows, then to 0 rows, back to 8 rows. This data is being used in a Dashboard on ESRI Portal for real time reporting. FME 2018.1.0.2 64 bit Build 18547 ArcDestop 10.3.1Thanks,
I generated some 3D tiles data using Cesium 3D tiles writer.Then shader effect is appeared in all of 3D tiles data.The Cesium 3D Tiles writer seems to write the shader effect in b3dm data by default.I would like to remove the effect from those 3D tiles data.Could you tell the solution?
Created a workbench to download and save on local disk, from S3 to local disk and read csv using featureReader works fine with FME Desktop (20181203 - Build 18578 - WIN64). Publishes same workbench to FME Server with additional parameters like file name etc and run through post call, failed to process csv file with following message: CSV reader: The keyword _DELIMITER has an invalid value: 'auto'. It must be a single character that is representable by one byte in utf-8BADNEWS: A fatal error has occurred. Check the logfile above for details (dynaread.cpp:199)A fatal error has occurred. Check the logfile above for details(dynaread.cpp:199). How do I track this fatal error ?
Trying to capture network traffic when FME Server writes to and reads from REST Services on ArcGIS Online to debug an issue with readers/writers and arcgis online. I followed all of these steps to setup and configure the proxy, but didn't seem to be working completely.Additionally, do we need to run fiddler on the account that FME server is ran on or can we do it through an admin account on the machine? We tried both Fiddler 2 and 4. In version 2, the FME account could see some of the traffic that was coming from jobs that were being ran in addition to traffic from the admin account. My admin account couldn't see any of the traffic from the FME user, but did see mine.
I am trying to read attachments from an AGOL feature service. Specifically, it is a jpg image. I have the reader feed into a BinaryDecoder set to Base64, outputting Binary(fme-binary), then going into a rasterreplacer. Error occurs on the BinaryDecoder. The error is:BinaryDecoder(TextEncoderFactory): Invalid Base64 character 'ÿ'Does anyone know how to handle or avoid this error? Thanks!
I have a MicroStation dgn file that I need to change the levels names, line styles, colors and weights to match our standards. Is there a way to read the attributes in one file and cross reference them in a excel spreadsheet or csv file and then write a new dgn file with the cross referenced attributes?
I have got a kmz file and I want to convert it to a shapefile. I also want to change the data from being a 3 coordinate system to a 2 coordinate system or I could keep the 3 coordinate system and ensure all the z coordinates are 0. There is not much help on how to transform kmz files to esri shapefiles in fme. Can someone give me some tips? I have attached the file here.
I'm trying to convert a NetCDF file generated by a climate model to be able to use in a GIS software. I have no specific software preferences.
Hi Safe.I seem to have stumbled across a bug in the WFS reader, that may also affect other OGC readers.Our local WFS services typically have a few extra parameters, e.g. "servicename", "login" and "password", or "ticket". These are given in the stub that the reader receives, and normally it works just fine.However, one of our services returned these parameters in the service stubs in the "capabilities" document, but had lowercased all the parameter names. I.e. the FME stub contained "Login=" and "Password=", but the returned capability-stubs had "login=" and "password=".Unfortunately FME handles this wrong, as it appends the camelcased parameters to the lowercased stub, because FME considers the parameter names to be different bacause of case sensitivity.The reason I say it's wrong, is because the OGC documents clearly state that "Parameter names shall not be case sensitive, but parameter
Hi,I have an Excel reader and one column of the Excel files contains merged cells.For an unknown reason, the option "expand merged cells" doesn't work well for some merged cells.For some merged cells, I got all values in the expanded cells and for some others, I got only 2 values for 5 cells that were merged (for example).(I tried to convert the Excel file in XLSX, XLS,.... the problem persists) So, I try to find a solution to fill empty values with previous values from the same column (attribute).I searched with the NullAttributeReplacer transformer or with a NullAttributeMapper but I don't find how to map to the previous value with this way... One other difficulty is that it must work in "cascade": for example the empty value from row 3 must get the value from row 2 and then the empty value from row 4 must get the value from row 3, and so on... Thanks for any help.Christian
Hello,I am using FME to create several zipped shapefiles (Not SHZ). And when I set my FeatureWriter to "PATH\\@Value(Tbl_Name).zip", the output folder is zipped but only contains the DBF file and nothing else. I am open to other suggestions on how I should be doing this. Thanks,Ben
I'm building quite a lot of flows where the amount of input features should always be the same as the amount of output features. During the processing of the data a lot of transformers merge, delete, split, and aggregate the data but in the end it should always result in the same amount of features as i started. I now use an UniqueValueLogger to list all the ID's in between and then compare it and at the end i do a manual check to see if the correct amount of features are written to the writer. But i was wondering if this could be tested with the tester and if it does not match can stop the translation raising an error that the input data is not correctly formatted.