Using readers and writers to extract and load data.
Recently active
hi, I'm attempting to set up this example using my fme cloud instance (to later modify) https://knowledge.safe.com/articles/1117/data-distribution-with-web-maps.html. I'm stuck at the part where it talks about the token. dataDist.init({ server: "http://fmeserverurl", token: "a1b2c3d4e5f6a1b2c3d4e5f6" }); How do I generate the token in FME cloud?
Hi,My customer asked me about the difference between Esri Legacy SDE and Esri Geodb ArcSDE, when he wants to Reader SDE. Thanks,Danilo
Hello: Is there any way to take the results of a writer and use them within a second reader (within the same workbench) ? I have this scenario: Reader_1 - Transformers - Writer_1 Reader_2 - Transformers - Writer_2 Is there any way that Reader_2 can read the results produced by Writer_1 within the same workbench? Thanks,
Hello FME Users,Someone did make any Workspace that use the transformer GCMMessenger? If yes, it was easy to configuration on Google Cloud Message?Thanks in Advance,
Is there any chance to convert STL format(3d printing) from SHP file or DWG file
Hi all,Would anyone be able to suggest a workflow of exporting non-spatial records from wfs service to csv format? It is a big file with property title information (2+ million records), so I was thinking about narrowing the search by specifying Land District (GetFeature?). I did not work much with wfs services so simplified explanation would be great.Maybe someone from New Zealand with data.linz experience, especially their wfs services?Regards,Maksym
Hi,I am using HTTPCaller to read the content of this webpage https://ir.euroinvestor.com/Solutions/Shell/2088/miniquote2.aspx and try to retrieve the price but seem that HTTPCaller cannot retrieve it. It only able to retrieve <div class="price"> </div>and no price. Anyone know how to get the value if the webpage is dynamic?Thank you.
Hello, i try to create dynamic Excel data i a german environment and have a problem with the datatype.As you see fme detects the same value as utf-8 and 64 bit real. Real values generate correct output in excel as number but utf is put out as string with dot as decimal limitter.Is there any way to force the datatype to real?Hendrik
Hi allFME Information Edition: FME Database Edition Version: FME(R) 2017.0.0.1 (20170316 - Build 17271 - WIN64) I have a 3D buildings dataset in different formats .shp and .dgn. Buildings are built from individual shapes (walls, roof parts etc.) Normals are not consistent, some being LHR (left hand rule) and some RHR (right hand rule). Based on manual check I know which normals are LHR and which are RHR in a sample data (attached ).I also have a version of data in .sqlite format where all normals are RHR.I need to identify direction of each normal with FME, but OrientationExtractor doesn't provide consistent and correct results, comparing to the results of manual check. FME recognizes some LHR as RHR and opposite, fx, indicating that some of the shapes in .sqlite data are LHR.I also tried using Orienter to ensure that all Shapes are oriented one way, and then using Orientation Extractor again, but it provides wrong results again. Data -> OrientationExtractor (LHR, RHR) ->
Hi, I am getting a fatal error while translating a DGN file to DWG format.Object Data Writer: Failed to create object data table named 'XXX' in datasetA fatal error has occurred. Check the logfile above for detailsKindly help me to translate a DGN file to DWG along with symbology like Colors, line styles, Cells (in DGN) = block (In CAD).Thanks in advance.
Hi,I have a MapInfo file which I am trying to convert to an ESRI Shapefile. I can open the file using the MAPINFO reader in FME Data Inspector but when using the same reader in FME this returns the below error: Failed to open native MapInfo file 'Biological_Heritage_Sites_Distribution_2012.tab' could not be opened as a MapInfo dataset.<br>I have tried using both the 32-bit and 64-bit versions of FME but receive the same error in both. The TAB file has all file elements within the same folder (.TAB, .ID, .DBF, .MAP) I have also tried both the TAB and MITAB readers. Is there anything else you can advise to try? Thanks in advance for your help with this.Thanks, Charlie
I am trying to set a published workspace parameter(s) to automate an ETL routine that reads multiple tables from one PostGIS DB to incrementally update another single table in a separate PostGIS database. The simple workflow is something like this: a) Multiple tables from a PostGIS database are read and concatenated in another separate PostGIS database table representing a single canonical theme of these records. These themes classify certain field collection survey records into a meaningful, single common theme. b) The second database does have a function which writes the id, feature_type and a run_date to an etl_log table each time the routine processes. I'd like to use this automated output as an input value each time an update routine is called on the server. I've tried to work in a SQL SELECT statement that filters only those records that have a created_at or updated_at attribute greater than (or after) the run_date and label those as "good", passing through to t
Hi,I have a IFC file that I want to use for a transformation. It has correct latitude and longitude values, but missing elevation values. I wanted to update the elevation value by using the AttributeValueMapper on the IFCSite class and giving it a fixed value for the RefElevation attribute. But strangely, after the transformation, not only the value for RefElevation is missing, but the values for latitude and longitude are gone, too. What am I doing wrong? I would be grateful for any help you are able to provide.
Hi, I tranform some rasters from a certain source format into GeoTIFF files with a jpeg compression (75). But by doing this, the background values are not anymore 0,0,0. Resulting in a series of (almost) black pixels at the border of the image. When writing to a GeoTIFF without any compression the 0,0,0 value of the complete border area is maintained and the background can be made transparant. Is there a way to use the compression and to keep the complete border area black (0,0,0)? Secondly, why is it not possible to use jpeg compression and the BigTIFF option at the same time in the writer? thx
Good morning!Today my FME Desktop 2017.0 has given me the following error while running a Workspace:It doesn't start at all. Not even the log is written.This is a workflow to update several metadata XML files. For the ID of those metadata I have used "fme_(type_of_metadata)". For the ATOM service and the Dataset metadata is working fine, but with the view service metadata always gives me the error from the pic.If I change the metadata ID to something else, the workspace runs without issue. So it seems I have hit some restricted words for the "metadat_id" variable value.Is there any place in the documentation where I could check which words we are forbidden to use?Thanks!
Hi, I've literally just started experimenting with FME. When I run, it says that the translation was successful. But it doesn't seem to create output. I get a "The source file isn't valid" error when I open the inspector, and when I browse to the folder there's no output file. I'm trying to convert a DGN to Esri shapefile, and I've literally just been following the steps on an online tutorial, and I've used their datafile, and my own. With both input files, I get the same error. Do I have to change something in my general FME settings, or are the settings on my PC the issue?
Hi,I am after a method to define the vertical co-ordinate system of features being output, particularly after using the 3DForcer or Vertex Creator.The data coming in doesn't already have the height datum defined, particularly as it is often from CSVs. Thanks-Jack
Hello folks,Simply, what I am trying to do with my script, is create a service that allows the person running my process on FME Server to add a Plan ID # to the start of a file deliverable name. Example:Current output file name: Complete_Data_DWG.dwgPublished Parameter "PLAN_ID" value: 24883Desired output file name: 24883_Complete_Data_DWG.dwgI have already tried using "$(PLAN_ID)_Complete_Data_DWG.dwg" but it only returns that exact string (with $(PLAN_ID) and not the user set value).Basically my script works and I am just trying to make it more aesthetically pleasing and to also provide better file management for my clients.Thank you for your time,Moe
Hi,I am trying to create one CityGML file based on two others. Both have the same CRS. I am not sure if I have to use transformers and if yes which ones? It did not work with only two readers and one writer. Maybe there is a solution by using XML-Transformers and the "CityObjectMember". It sounds like an easy task but I am new to FME. By the way, I am using FME Desktop 2017.1 Thanks, The Cartographer ;-)
I am new to using FME cloud, can you please explain how I can install custom python libraries onto FME Cloud and call them before the workbench runs. I would like to drop and create an elasticsearch index before the workbench then goes and populates it.Many Thanks,OliverThe current python code is:import pyodbc, jsonfrom elasticsearch import Elasticsearches = Elasticsearch([{'host': 'search-dev-elasticsearch-z4b7vwlsqswv4uial343rdjccq.us-east-1.es.amazonaws.com', 'port': 443}],use_ssl=True,verify_certs=False)es.indices.delete(index='productdownloadsdb_full', ignore=[400, 404])mapping = '''{ "mappings": { "downloads": { "properties": { "HYPERLINK_PDF": { "type": "text" }, "HYPERLINK_ZIP": { "type": "text" }, "ID": { "type": "integer" }, "PDF_BODY": { "type": "text" }, "PDF_FILE": { "type": "text" }, "Title": {
Hello everyone, We are doing a prototype where the geometries from Oracle spatial are imported to GE smallworld and are adjusted to new locations. The old and new locations are maintained in a CSV file and the source Oracle data is to be modified based on this CSV file using FME. Each and every coordinate in the Oracle spatial data will have it's original geometry and the adjusted geometry in the CSV file. I wanted to know if I can use FME to update all the oracle spatial coordinates with the new coordinates from CSV file. If I can, how to achieve this. Appreciate any pointers and help in this. Thanks, Kalyan
I have a workspace that uses the GeoRSS reader that spatializes a newsfeed and writes to an SDE feature class. The newsfeed carries 25 items per day and a handful of news stories are posted each day. How do I configure the parameters in the writer to retain all of the old items and "append" only the new items, so as to preserve all items and build a running total?
Hi,How can i store _packed attributes which is having multiple attributes packed by AttributejSonPacker?Can i store that _packed attribute as BLOB type attribute in File Geodatabase?Thanks in advance.
I want to create a new autocad layer (aka fme_feature_type) and add it to an existing drawing with a specific layer color property. Any ideas?
I am using Update write to do updates to a version in esri geodatabase and wonder how to I tell the writer to only update attributes and not geometry. Has anyone done something similar? Thanks!