Data

Hi,I've been processing data and writing outputs to PostGres tables that are created by the writer. I've created a number of writer feature type by copying an existing feature type and renaming them. Every writer feature type has a unique name, followed by a parameter indicating the year. However, this seems to cause an issue where FME considers the copied + renamed feature type to be the same as the original on some level, and refuses to write to it.FME 2017.1 (build 17539) gives a somewhat vague warning about feature types but continues processing:2018-07-04 10:42:52| 102.1|  0.0|WARN  |=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-2018-07-04 10:42:52| 102.1|  0.0|WARN  |      Features not written - verify feature type fanout/dynamic settings2018-07-04 10:42:52| 102.1|  0.0|WARN  |=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-2018-07-04 10:42:52| 102.1|  0.0|WARN  |  (Check that fanout/dynamic feature type attribute exis

Hi,Is it possible to create normal/highlighted KML icons with KML FeatureWriters instead of the standard KML Writer shown in the FME example Here: I am exporting an entire SDE database to 6 different formats and used FeatureWriters to convert/insert a disclaimer into the zipped datasets.  Thanks! 

Hi all,I am a newer user to FME, and I am using FME Workbench 2017.0.I have a new feature class that has coded domains. The data being input into the new feature class is coming from a feature class in an old MDB. I would like to delete attribute values from each field that does not have values within their respective coded domains, and they can either be null or empty strings.The picture shows an example of some of the data where you can see BUR-T does not exist as a coded value in responsible_agency or maintained_by, but it exists in pipe_owner. Or STR does not exist as a coded value in pipe_owner or maintained_by, but it exists in responsible_agency. I used AttributeValueMapper to get to this point.Note: I have tried making a query to delete values with char_length < #, deleting uppercase values, and etc., and those did not seem to work because the 'Town of Burke' and 'Streets Division' values are still recognized as their codes, so they are subsequently deleted w

Hi,new here. Just want to ask how do I extract data from xml below into an Excel Table. Problem I specifically can't get over with is how to make the attribute name into a column heading in Excel and how to extract from inside the groups.Cheers.<?xml version="1.0" encoding="windows-1252" ?> <file name="EMP_RECORD" version="3.0.0"> <schema>  <group name="EMP_RECORD_HOURS_DAY_DATE">  <field name="HOURS_DAY_DATE">  <desc>Effective Date</desc>  <just>R</just>  <len>12</len>  <type>DATE</type>  </field>  <field name="HOURS_DAY_CODE">  <desc>Hours/Days Register</desc>  <just>L</just>  <len>2</len>  <type>VARCHAR</type>  </field>  <field name="PAY_GROUP">  <desc>PAY_GROUP</desc>  <just>L</just>  <len>20</len>  <type>VARCH

I have a folder that has approximately 50 XML files in it. Between one and three new XML files are added to the folder each day. Each of these files needs to be sent to an AWS S3 bucket. Ideally, every morning FME would scan the folder for new XML files and upload only the new files to the S3 bucket.   Does anyone have an example workspace or best pracitces they can share? There seems to be many ways to do this, but I would love some guidance on the most efficient and reliable route. I have both FME Desktop and FME Server.Thanks!!

Hi, I am using the FME Server REST API and needing some guidance.I have a published workspace in FME Server and run daily via the scheduler to output a .json file on my FME Server. I am trying to call the data with the FME Server REST API to retrieve the .json file so that I can hand it over to our web developer for him to use for an application he wrote. I do not want the FME Server Job to run everytime an API call is made to get the .json file/data. I am new to using the FME Server REST API but have tried playing around with the API v3 GET GET /repositories/< repository >/items/< item >/datasets/< dtype > Can someone please help me to get on the right track on using FME server to get my data via an API call/URL?Thanks!  

Hi everyone, I hope my question will be clear to understand. I have a workspace that generates a single list CSV of photos from multiple tables in a Postgres database, each with a UUID to identify it in the bucket. It looks like this:   This list is output to the (FME_SHAREDRESOURCE_DATA) directory on FME Server, which I then want to call it from and use to parse the photos from the S3 bucket and move them to another S3 bucket. I need to use the Cloud/Server resources as the total size of these photos can reach multiple GB’s and would cause too much latency on my office WAN. How can I achieve this using the S3 transformers offered with FME to move objects between S3 buckets without downloading the photos locally? Or is this even possible in a single or multiple workspace(s)? I would also need to perform this on video files as well. Thanks in advance for the assistance. Todd

Morning,When I run the following using sql executor using the SQL Server Native client I get back a result.EXEC [dbo].[SP_API_VALID_SUBSCRIBER] @modules = N'1,2,3,4,5,6,7,8,9',        @clippolygon = N'POLYGON ((-168.046875 -85.62206859340185,183.515625 -85.62206859340185,183.515625 83.35951133035452,-168.046875 83.35951133035452,-168.046875 -85.62206859340185))';When I run the same query using the JDBC driver for SQL Server no spatial I get no results back, although the sql execution was successful no results are returned. I have tried with and withougt the 'commit;' at the end of the script and this has no effect.Does anyone have any ideas why this might be?Many Thanks,Oliver

I am creating an excel output with two sheets. I am using an excel template to populate relevant date to the sheet. All data being written to the excel (total of records 656), sheet 1 has relevant 299 records inserted (rows from 1 to 300) however sheet 2 has its data being written on the row 555 (the rows of 0 to 554 are empty). The start row in both sheets is set to 1 but this not being pick up by the sheet 2. Not too sure what I am doing wrong here, any help would be much appreciated.Thank you,Natalia

Is there a way to set different Z values for each vertex of a line/polygon from a list, like the MeasureSetter in Whole Line/Area mode?  The 3DForcer sets all the vertices to a single elevation, and the VertexCreator replace point at vertex i only does one vertex at a time. 

GoalI want to use FME-server as endpoint for sensordata (senML). This sensordata is posted from the sensors to our server with JSON as body. SituationI created a workspace which is comparable with the posts as described in these posts and everyting related to thishttps://knowledge.safe.com/articles/1295/send-source-data-to-fme-server-with-http-post.htmlhttps://knowledge.safe.com/questions/35741/how-do-you-initiate-a-job-submitter-service-via-ht.html The last URL also contains my question from earlier today, but I got advised to create a new topic.In short my workspace contains: a textfile reader with the setting 'read the whole file at once'some transformers to interprete the jsonpostgis writerThe workspace works perfectly when running from my computer with FME workbench.I uploaded the workspace to FME-server, using the jobsubmitter as service and in the settings of the service I pointed to the reader (Send HTTP Message Body to Reader)Problem/testingI'm using Postman to test posting th

Hey,I am fairly new to FME and I was recently using the MongoDB reader to read some data from Mongo, transform the data and write the same structure back to Mongo using the MongoDB writer, I get however a strange output while doing that. The input structure looked something like that: "test" : [{"type" : "my_test"}], but when writing back to Mongo the output looks like that: "test" : ["{ \\"type\\" : \\"my_test\\" }"]. Could someone tell me what the problem might be?Thank you very much in advance :)Kathrin

Good morning!I need to connect to this WFS service using FME:https://inspire.navarra.es/services/CP/wfs?request=GetCapabilities&service;=WFSBut everytime I get this error:XML Parser error: 'URL protocol 'vfs' is unsupported'I have no idea what could be wrong. I use other WFS services with no problem.Does anybody know what that error means?Thanks for any help provided!FME Desktop 2018.0

Is there a way to read styling from ArcSDE? Similar to when you read DWG you get styling also. If not, any workarounds?

HelloI use a ORACLE non spatial writer (shortname ORACLE8I_DB), non-dynamic i.e. fixed definition of attributes. One of the attributes is defined as: HSN varchar2(10)If I use this in my environment and if the attribute HSN is longer than 10 it gets written without any error or warning and is cut to length 10.Problem:If a customer in a different Oracle environment uses the same workspace with the same data the writer stops with ERROR complaining that the value is too long.One time it cuts the data without any message, the other time it stops with ERROR.Does anyone have an idea what maybe the reason for the different behaviour in the Oracle environments ?Our Oracle expert says there is no option in Oracle to control this. Google didn't help either ...Thanks for any hintMichael

Hi,I have a workspace that reads some data and after some processing it writes the data via feature writer inside an postgis database. Afterwards more sql scripts are triggerd via sql executors. At the end all data is read again for final writing via FME.The problem is that the time increases exponentially when the processed data becomes larger (taking a few hours to a few days).In the processing part I can split my data into smaller parts and write this data in multiple schema's in postgis. The problem is that I can't run the next sql scripts in parallel on the X amount created schema's. If I trigger every script x times, this triggering is done sequentially and timing remains the same.If I try to put the longest script into a separate workspace runner, I can only run this WSR in parallel when I say that it should not wait for completed job, but then I have an issue with the latest step (= combining all data from X schema's into 1) as the table is not yet existing (or

Hello,I am currently working on extending the IFC Schema for infrastructure. I have designed graphically (EXPRESS-G) the proposed changes and I am wondering whether it is feasible to embed the new classes in the existing FME Writers, or create new FME Writers with the properties of the proposed extension.I have accomplished a similar thing when I wanted to create some extra writers for CityGML via the environment of FME Workbench, but I am pretty sure this is slightly more complicated.Thank you for your time.Kind regards,George

Hi,We have been using FME to write updates to our hosted feature layers on AGOL for some time. Lately the process has been failing with this error message: "ArcGIS Online Feature Service Writer: 'updateResults' error for a feature in 'Schedule of Native Title Determination Applications'. The error code from the server was '1000' and the message was: '24301: Expected a call to BeginGeometry(Polygon) or EndGeometry, but BeginFigure was called." Has anyone seen this, have any idea what the problem might be? Thanks

I have classified LAS-data to get high vegetation. I now need to get tree position for the center point of the point clusters (every cluster is one tree).I want one point for each tree with z(height) attribute, to construct a base for generating at tree model of our city. How do I manage this in FME?Best regards, Tobias

I want to get my textured MP models into Revit while keeping the texture. Is this possible somehow? I tried going through IFC first, but color is all I managed to get to transfer. Are textures even possible? I'm also open to other ways of getting the models into Revit. Only geometry is fine too, the attributes are currently irrelevant.

Is there any way to put all writers into one transaction so that it only commits the changes when there is no other work left to be done by the workspace, i.e. performs a rollback on the database on a failure outside of FME?More details on the matter:I have a workspace with one input file and multiple database writers that update seperate tables (Oracle non-spatial). I want to be absolutely sure that eitherway ALL features are written, or none at all on failure. How to achieve this?Because the current situation is as follows:Workspace fails with database or network error Some tables are updated (those that came first) and some tables aren't.We tried using a SQL Executor as one of the first steps, to execute 'set transaction read write', hoping there would be one commit for all database writers or as one of the last steps of the workspace.This works when the workspace fails with a Terminator transformer, but when the translation failes with a database error instead (for exam

Creating a drawing from shapefiles but my block attributes are merge all together.I have several blocks are being created by fme. The Attributes for all the blocks are being merge to every different blocks. I think when i setup my writer for autocad is not correct. What is the correct method on creating block with AutoCad drawing without merge all block attribute together?TMT-1132.jpg show block create by Autocad Insert method.FME-TMT-1132.jpg show block create by FMEFME-WRITER-AUTOCAD.JPG example of my writer

Hi everybody,  I am trying to figure out how to write metadata to ArcGIS Online Feature Service (update existing). I am able to read metadata from SDE using the "geodb_metadata_string" format parameter when setting the feature read mode to "Metadata" on the reader, but not being able to write to ArcGIS Online.  Is this even possible?  ?Thank you.

I'm doing a fairly straightforward IFC conversion. It runs once correctly and then every time I try it again, it errors out with the below messages. When I create a new writer it works, but also only once. What's up with that?Dataset template source `<Unused>' for writer GEODATABASE_FILE_1 could not be located Dataset template source `<Unused>' for writer GEODATABASE_FILE_1 could not be located f_72(CreationFactory): Dataset template source `<Unused>' for writer GEODATABASE_FILE_1 could not be located Dataset template source `<Unused>' for writer GEODATABASE_FILE_1 could not be located

I create Point Clouds from Drone photography using Pix4D. It outputs both .XYZ and .LAS files. Pix4D also generates contours but I am not satisfied with the output - it's too generalized. I want to create highly detailed contours from the Pix4D point cloud output. I also want to optimize them with the FME Curvefitter transformer and output to an AutoCAD DWG. I have tried several processes using the PointCloudXYZ reader and also the PointCloudCoercer but have not been successful creating an AutoCAD Polyline output that can be Curvefit. Can you give me some pointers?