Using readers and writers to extract and load data.
Recently active
I would like to label all the cells in a DGN file.
Is there a way of creating a Workspace where I can have a selection list (user parameters) of Feature Type (GIS.WaterMain, GIS.CombinedMain) to read the Schema with attributes (is this dynamic of generic)?I've been able to create a Dynamic Reading but Schema is fixed to attributes in the Reader, Generic is only shows on field.
@shazad.tareen@gmail.com
Hi,I have a dgn with faces which I want to convert to fme surfaces to be able to put texture on them. FME reads these faces form dgn as polygons. I tried to convert these polygons to faces with the FaceReplacer but a lot of the polygons failed because they are not planar. If the FaceReplacer works I plan to use the GeometryCoercer to convert the faces to surfaces. Does anyone have an idea how to solve this problem?Thank you
FME 2019.0 build 19238 Desktop on Windows 10 and Server on Linux (CentOS 7)I'm trying to migrate a large dataset (tens millions records) from a Google BigQuery table into a PostgreSQL table, but the translation failed and this error was logged. Tried some times, the translation stops always with the same error.Translation FAILED with 1 error(s) and 0 warning(s) (11375000 feature(s) output)FME Session Duration: 59 minutes 9.9 seconds. (CPU: 1945.4s user, 53.5s system)END - ProcessID: 11848, peak process memory usage: 1027252 kB, current process memory usage: 843964 kBjava.lang.Exception: Google BigQuery: Error retrieving query results from job '****************:********.********' executed on table job_*_***************. Provider error: 401 Unauthorized{ "code" : 401, "errors" : [ { "domain" : "global", "location" : "Authorization", "locationType" : "header", "message" : "Invalid Credentials", "reason" : "authError" } ], "message" : "Request had invalid authentication
I am running FME Desktop 2018.1 in a Windows 10. My source data is in a SQLServer database (2016 R2) and the destination feature class is in an ESRI Enterprise Geodatabase (ver 10.5.1) also using SQLServer (2016 R2) as the backend database.The destination feature class is in a Enterprise spatial data warehouse, business decisions are make on the contents in the destination feature class.I have a FME Workspace that reads a table with latitude and longitude and writes to a feature class in a ESRI Enterprise Geodatabase.The writer is set to TABLE Exists: 'yes', TRUNCATE Table First: 'yes' It appears that FME:1) Truncates data in the destination feature class, then 2) Reads the source table, then 3) Writes to the destination feature class. Is this correct or have I misinterpreted the FME log files? If this is correct, then there can be considerable time when the destination feature class is empty or being updated. If FME does truncate the destination data first, then can I
I have created an Excel template to be used as backup for billing expenses. The invoice has a header with specific places for billing date range(start, end), project name, project number, and project manager. The final output has a separate sheet for each project number. I have added AttributeManager to get rid of all of the other attributes and only have the 5 I need to insert into my template - the itemization is added later. I have everything working except getting the aggregated attribute value (i.e. project name) added to the named cell. How do I specify where to write each attribute?Version 2018.1 Desktop
I have a list of code numbers and descriptions. i wish top converted them into an xml file that has parent child relationship. Can any suggest tutorial or content that is appropriate? Thanks Bhere is a screen shot of my listand here is what i need
I have a Workspace running in FME Desktop 2017.1.1.1 on a server. The Workspace has a SQL Server Spatial Reader in it. The SQL Server database is on a different server which is in the same domain. The Reader is using a named SQL Server connection which is publicly visible. The connection uses SQL Server credentials to connect to the database (not Windows authentication). The connection is not encrypted.The Workspace runs fine when I'm logged in. It works as a scheduled task when running as me. But when I try to run it as a scheduled task using a different user (we have a Domain service account for running scheduled tasks), it fails. I've tried the registry fix suggested here:https://knowledge.safe.com/articles/32356/scheduling-software-doesnt-recognize-fme-connectio.htmlHowever I still get "Invalid authorization specification" in the log file. Interestingly, since applying the above fix, I also get errors about encryption (see below). I don't know if this
Hi, I want to overlay labels from a FGDB point file on a raster. I'm using the Labeller transformer but my points never pass through. I've uploaded a workbench. Thanks for any help.B
Hello,Main Query: I need to connect to an InterBase DB and it's not listed in the "Reader Gallery".I have installed the ODBC driver(s) for it. Can someone please advise how to go about creating this database connection possibly using the FDS file import? What about making use of an ODBC connection? I can already connect to this database using the IBProvider driver on a different server using a different application. In this particular case though, I must use FME to connect to this table to build a test Corporate Notification Service.Secondary Queries:I also noticed that Ingress was not listed as a "Reader Format" by default. Do you have any plan for implementing this? Has anyone managed to use FirmStep APIs in FME? Thanks,Sameer
In some of my workbenches in FME Desktop I can have over 400k of rows to update to a ArcGIS hosted portal feature service. However the writer will fail somewhere between 400k to 450k, roughly after an hour of updating. I think this is the token from portal expiring, but can't find a way to change the expire duration in FME Desktop when it gets a token from portal. Is there a way around this?
I need to figure out a way of testing if a writer which is an SDE layer is verisioned or not. If it is versioned I do not want to truncate and fill if from the reader but if it is not versioned then I would want to truncate and fill.
I'm sure I'm overlooking something embarrassingly simple but after adding 2019.0 to my computer (currently also have 2018.1 installed to a different path) I cannot complete addition of a .csv reader. I'm able to preview the input files and they show the correct column names and content, but the 'ok' button is greyed out. . preventing me from ultimately adding the reader. Automatic and Manual attribute definition give the same result. I don't have this issue with the Excel reader. Thanks in advance - pulling my hair out!
I would like to color the cells of my first column ID_WS based on the text value contained in a cell UPDATE_STATUS which basically contains the fme_db_operation value.I tried to apply the styling with ExcellFormater but it doesn't seem to be working in the output. What am I doing wrong here ? Thank you !
HiI need to extract info from XMLI used the HTPP caller but now I need to extract the string related to tag <tbody> (see picture) and I don't know how can procede thx Francesco
Hey, I am dealing with a data migration from File Geodatabase to Microstation DGN right now. I am wondering whether it is possible to set the value for the attribute igds_model_name in the DGN Feature Writer. The only accesible attribute is igds_xref_model_name. But I need igds_model_name, because right now all written features get the value Default, which is wrong. The values I want to write are RB, GEM and DIG. They are currently saved in an attribute in a File GGeodatabase.
I have a workspace to convert shapes files to Postgis 1.5 working fineIn the same workspace, I change the conection parameters to conect the same table in Postgis 2.1 but I get an error because of Srid restriction.Reading the log, I see is trying to write SRID=1 (the postgis restriction is to Srid=25830, in both versions of Postgis, so it returns an error)The conection parameters are the same in both conectionsIf I inspect the entity that its trying to write, the properties gives EPSG:25830 Coordinate System,but in the log writes SRID=1Why is trying to load Srid=1 when I change conection to Postgis 2.1? Thanks
I have two KMZ files containing states and cities borders. I want to combine them and find out which city falls under which state as a result in some tabular format. How I can achieve this with FME? Are there any transformers available for this?
I do not see a reader yet that can read a GeoJSON file in S3. Rather than needing to download it via the S3 transformer.We would like to use S3 as a spatial data hub so it can be used by many tools.
I'm using FeatureReader with following parameters:Dataset: $(Source_WFS:)Feature Types To Read – From Attribute: _FETURE_TYPES$(Source_WFS:) is composed of some fixed URL address (below is an example one, not the real one I'm using) plus dynamically generated token by Python script in private parameter called Token which is:import fmeobjectsimport urllibimport urllib2import jsonusername = FME_MacroValues['Username']password = FME_MacroValues['Password']client = FME_MacroValues['Client']expiration = FME_MacroValues['Expiration']format = FME_MacroValues['Format']url = 'https://www.example.com/tokengen/'values = {'username': username, 'password': password, 'client': client, 'expiration': expiration, 'f': format}data = urllib.urlencode(values)request = urllib2.Request(url, data)response = urllib2.urlopen(request).read()jsonToken = json.loads(response)return jsonToken['token']This worklfow works perfecty in FME 2014, but in FME 2018 I get the error, when trying to load features to Output po
Hi. I want to export some fields from shape file to excel. Any help in this regard would be highly appreciated.
Hi all,I've 3D model of building sample as you can see at the .jpg file.I worked in the .dgn file.But when i import .dgn file to FME data inspector i've more geometry about drawing.I think that FME is handing logs .dgn file geometry history cause i copied exactly same coordinate into building room drawing geometry. So, how can i resolve this problem? Can i resolve in FME Desktop with transformers? (MS Drawing)(Same .dgn file looks in FME)
Hello, What we do is get KMZs and run the ArcGIS tool to convert them to to layers in a file GDB. When you use the layer in ArcMap there is a field PopupInfo, which has HTML data we need to extract?? I have tried several recommendation with HTML, but nothing gets me to where I can flatten the data out into a usable table. Please let me know any suggestions?
Hi there... Sorry about my English. I'm trying to translate survey drawings made in Autodesk Civil 3D 2017 and 2019 to GDB using CoGoPoints and Survey Figures. For CoGoPoints no problems at all, but Survey Figures are not supported at my FME ESRI Desktop 2017.0.0.1.If the Survey Figure is supported by FME Desktop 2018 or newest, I will ask to my company for a software update, if not I need change my strategy. Thanks in advance! Demetrius