Using readers and writers to extract and load data.
Recently active
Morning,When I run the following using sql executor using the SQL Server Native client I get back a result.EXEC [dbo].[SP_API_VALID_SUBSCRIBER] @modules = N'1,2,3,4,5,6,7,8,9', @clippolygon = N'POLYGON ((-168.046875 -85.62206859340185,183.515625 -85.62206859340185,183.515625 83.35951133035452,-168.046875 83.35951133035452,-168.046875 -85.62206859340185))';When I run the same query using the JDBC driver for SQL Server no spatial I get no results back, although the sql execution was successful no results are returned. I have tried with and withougt the 'commit;' at the end of the script and this has no effect.Does anyone have any ideas why this might be?Many Thanks,Oliver
I am creating an excel output with two sheets. I am using an excel template to populate relevant date to the sheet. All data being written to the excel (total of records 656), sheet 1 has relevant 299 records inserted (rows from 1 to 300) however sheet 2 has its data being written on the row 555 (the rows of 0 to 554 are empty). The start row in both sheets is set to 1 but this not being pick up by the sheet 2. Not too sure what I am doing wrong here, any help would be much appreciated.Thank you,Natalia
Is there a way to set different Z values for each vertex of a line/polygon from a list, like the MeasureSetter in Whole Line/Area mode? The 3DForcer sets all the vertices to a single elevation, and the VertexCreator replace point at vertex i only does one vertex at a time.
GoalI want to use FME-server as endpoint for sensordata (senML). This sensordata is posted from the sensors to our server with JSON as body. SituationI created a workspace which is comparable with the posts as described in these posts and everyting related to thishttps://knowledge.safe.com/articles/1295/send-source-data-to-fme-server-with-http-post.htmlhttps://knowledge.safe.com/questions/35741/how-do-you-initiate-a-job-submitter-service-via-ht.html The last URL also contains my question from earlier today, but I got advised to create a new topic.In short my workspace contains: a textfile reader with the setting 'read the whole file at once'some transformers to interprete the jsonpostgis writerThe workspace works perfectly when running from my computer with FME workbench.I uploaded the workspace to FME-server, using the jobsubmitter as service and in the settings of the service I pointed to the reader (Send HTTP Message Body to Reader)Problem/testingI'm using Postman to test posting th
Hey,I am fairly new to FME and I was recently using the MongoDB reader to read some data from Mongo, transform the data and write the same structure back to Mongo using the MongoDB writer, I get however a strange output while doing that. The input structure looked something like that: "test" : [{"type" : "my_test"}], but when writing back to Mongo the output looks like that: "test" : ["{ \\"type\\" : \\"my_test\\" }"]. Could someone tell me what the problem might be?Thank you very much in advance :)Kathrin
Good morning!I need to connect to this WFS service using FME:https://inspire.navarra.es/services/CP/wfs?request=GetCapabilities&service;=WFSBut everytime I get this error:XML Parser error: 'URL protocol 'vfs' is unsupported'I have no idea what could be wrong. I use other WFS services with no problem.Does anybody know what that error means?Thanks for any help provided!FME Desktop 2018.0
Is there a way to read styling from ArcSDE? Similar to when you read DWG you get styling also. If not, any workarounds?
HelloI use a ORACLE non spatial writer (shortname ORACLE8I_DB), non-dynamic i.e. fixed definition of attributes. One of the attributes is defined as: HSN varchar2(10)If I use this in my environment and if the attribute HSN is longer than 10 it gets written without any error or warning and is cut to length 10.Problem:If a customer in a different Oracle environment uses the same workspace with the same data the writer stops with ERROR complaining that the value is too long.One time it cuts the data without any message, the other time it stops with ERROR.Does anyone have an idea what maybe the reason for the different behaviour in the Oracle environments ?Our Oracle expert says there is no option in Oracle to control this. Google didn't help either ...Thanks for any hintMichael
Hi,I have a workspace that reads some data and after some processing it writes the data via feature writer inside an postgis database. Afterwards more sql scripts are triggerd via sql executors. At the end all data is read again for final writing via FME.The problem is that the time increases exponentially when the processed data becomes larger (taking a few hours to a few days).In the processing part I can split my data into smaller parts and write this data in multiple schema's in postgis. The problem is that I can't run the next sql scripts in parallel on the X amount created schema's. If I trigger every script x times, this triggering is done sequentially and timing remains the same.If I try to put the longest script into a separate workspace runner, I can only run this WSR in parallel when I say that it should not wait for completed job, but then I have an issue with the latest step (= combining all data from X schema's into 1) as the table is not yet existing (or
Hello,I am currently working on extending the IFC Schema for infrastructure. I have designed graphically (EXPRESS-G) the proposed changes and I am wondering whether it is feasible to embed the new classes in the existing FME Writers, or create new FME Writers with the properties of the proposed extension.I have accomplished a similar thing when I wanted to create some extra writers for CityGML via the environment of FME Workbench, but I am pretty sure this is slightly more complicated.Thank you for your time.Kind regards,George
Hi,We have been using FME to write updates to our hosted feature layers on AGOL for some time. Lately the process has been failing with this error message: "ArcGIS Online Feature Service Writer: 'updateResults' error for a feature in 'Schedule of Native Title Determination Applications'. The error code from the server was '1000' and the message was: '24301: Expected a call to BeginGeometry(Polygon) or EndGeometry, but BeginFigure was called." Has anyone seen this, have any idea what the problem might be? Thanks
I have classified LAS-data to get high vegetation. I now need to get tree position for the center point of the point clusters (every cluster is one tree).I want one point for each tree with z(height) attribute, to construct a base for generating at tree model of our city. How do I manage this in FME?Best regards, Tobias
I want to get my textured MP models into Revit while keeping the texture. Is this possible somehow? I tried going through IFC first, but color is all I managed to get to transfer. Are textures even possible? I'm also open to other ways of getting the models into Revit. Only geometry is fine too, the attributes are currently irrelevant.
Is there any way to put all writers into one transaction so that it only commits the changes when there is no other work left to be done by the workspace, i.e. performs a rollback on the database on a failure outside of FME?More details on the matter:I have a workspace with one input file and multiple database writers that update seperate tables (Oracle non-spatial). I want to be absolutely sure that eitherway ALL features are written, or none at all on failure. How to achieve this?Because the current situation is as follows:Workspace fails with database or network error Some tables are updated (those that came first) and some tables aren't.We tried using a SQL Executor as one of the first steps, to execute 'set transaction read write', hoping there would be one commit for all database writers or as one of the last steps of the workspace.This works when the workspace fails with a Terminator transformer, but when the translation failes with a database error instead (for exam
Creating a drawing from shapefiles but my block attributes are merge all together.I have several blocks are being created by fme. The Attributes for all the blocks are being merge to every different blocks. I think when i setup my writer for autocad is not correct. What is the correct method on creating block with AutoCad drawing without merge all block attribute together?TMT-1132.jpg show block create by Autocad Insert method.FME-TMT-1132.jpg show block create by FMEFME-WRITER-AUTOCAD.JPG example of my writer
Hi everybody, I am trying to figure out how to write metadata to ArcGIS Online Feature Service (update existing). I am able to read metadata from SDE using the "geodb_metadata_string" format parameter when setting the feature read mode to "Metadata" on the reader, but not being able to write to ArcGIS Online. Is this even possible? ?Thank you.
I'm doing a fairly straightforward IFC conversion. It runs once correctly and then every time I try it again, it errors out with the below messages. When I create a new writer it works, but also only once. What's up with that?Dataset template source `<Unused>' for writer GEODATABASE_FILE_1 could not be located Dataset template source `<Unused>' for writer GEODATABASE_FILE_1 could not be located f_72(CreationFactory): Dataset template source `<Unused>' for writer GEODATABASE_FILE_1 could not be located Dataset template source `<Unused>' for writer GEODATABASE_FILE_1 could not be located
I create Point Clouds from Drone photography using Pix4D. It outputs both .XYZ and .LAS files. Pix4D also generates contours but I am not satisfied with the output - it's too generalized. I want to create highly detailed contours from the Pix4D point cloud output. I also want to optimize them with the FME Curvefitter transformer and output to an AutoCAD DWG. I have tried several processes using the PointCloudXYZ reader and also the PointCloudCoercer but have not been successful creating an AutoCAD Polyline output that can be Curvefit. Can you give me some pointers?
I have a spreadsheet with two worksheets (sheet1 and sheet2). I have a second spreadsheet which lists all the records that need to be removed from both worksheets, the new edited output will be in sheet1_v2 and sheet2_v2.How would you advise I move forward with this?Many thanks
HiI have a workspace that extrudes texture files (appearance) from my CityGML buildings, puts them together and creates a simple single texture atlas image file to improve performance when viewing the photorealistic model. The source CityGML file is a textured building with multiple texture image files, one image for each surface. The problem is that FME's CityGML writer always writes by default it's "own" appearance module (if the source file had textures) to the output CityGML file and copies the texture coordinates and imageURI parametres from source, which in this case is a CityGML file with a reference to multiple texture files instead of one texture atlas raster image. I only want to modify the existing appearance module, which i managed to do, but the writer still writes out appearance module to the CityGML file. As a result i have a CityGML file with two different appearance module where the other module references to my newly created texture atlas image with
This is just a quick note to inform you that we will be releasing a new search tool for the Knowledge Center in the next 1-2 weeks.Built on the Coveo platform, this tool includes a machine learning component and will auto-tune results and rankings over time to ensure users are receiving the most relevant results based on queries and clicks. We will also be adding more sources in the near future and have plans to roll this out across our other websites in time.A preview is available now at https://search.safe.com/ and we’re looking forward to seeing some real world data in the system. When we officially release, the search will be integrated into the main search field across the Knowledge Center, but for now we’d appreciate it if you could click over and give it a try.
As I have seen in https://knowledge.safe.com/articles/1070/thinning-and-combining-point-clouds.html It is possible to do points cloud thinning in FME. My problem is that I don't want to thin them by any of offered possibilities. In places with similar altitude, I would like to delete more points, and in places with higher elevation differences I would like to keep more points. For beginning I am extracting coordinates but I am not sure how to use that for filtering and thinning the las point cloud. Thank you all in advance for all the help.Dejan
When I attempt a simple conversion of a MrSID file to an ECW via a reader and writer (something I've done successfully many times) I am getting the following results/error: Command-line to run this workspace: C:\\apps\\FME\\fme.exe C:\\Users\\DOUGBL~1\\AppData\\Local\\Temp\\wb-xlate-1519219239276_15664 --SourceDataset_MRSID "C:\\MapData\\Williamson County\\SID\\Williamson_Co_2014.sid" --DestDataset_ECW "C:\\MapData\\Williamson County\\ECW" Starting translation...FME 2016.1.0.0 (20160419 - Build 16492 - WIN32)FME_HOME is 'C:\\apps\\FME\\'FME Professional Edition (node locked-crc)Serial Number: H8U9-DF32-16TZPermanent License.Machine host name is: DESKTOP-5NGB2S9START - ProcessID: 14816, peak process memory usage: 29096 kB, current process memory usage: 29088 kBFME Configuration: Command line arguments are `C:\\apps\\FME\\fme.exe' `C:\\Users\\DOUGBL~1\\AppData\\Local\\Temp\\wb-xlate-1519219239276_15664' `LOG_STANDARDOUT&#
I have an ~80gb file that i need to split into around 15 files geographically into 25x100 strips. https://knowledge.safe.com/articles/1100/tiling-point-cloud-data.html is helpful but FME will still read the whole file in one go. i only have 16-32GB of RAM (depending on computer im using) and so the computer will fall over. how can i split this file geographically and get around FME reading the whole file in one go?
CREATE OR REPLACE TRIGGER invoice_before_delete BEFORE DELETE ON prj_invoice_work_exe FOR EACH ROW DECLARE v_username varchar2(10); BEGIN SELECT user INTO v_username FROM dual; INSERT INTO prj_invoice_work_exe1 ( PIE_PIN_ID,PIE_TDT_ID,PIE_ID,PIE_QTY_EXECUTED,PIE_UNIT_PRICE,PIE_NET_PRICE,PIE_INVOICED_AMOUNT,PIE_UNT_CODE,PIE_HST_UNIT_PRICE, PIE_HST_TOTAL_QTY,PIE_HST_TOTAL_BILLED_QTY,PIE_HST_ALLOW_TO_BILL_QTY,PIE_HST_PRCT_OF_COMPLETION,PIE_HST_QTY_COMPLETED, PIE_PWR_ID,PIE_DISCOUNT,PIE_DOWN_PAYMENT_RECOVERY,PIE_BOQ_DISCOUNT,PIE_BOQ_DOWN_PAYMENT,PIE_UNT_PRICE_BFR_DISCOUNT, PIE_TOTAL_PRICE_BFR_DISCOUNT ) VALUES ( :old.PIE_PIN_ID,old.PIE_TDT_ID,old.PIE_ID,old.PIE_QTY_EXECUTED,old.PIE_UNIT_PRICE,old.PIE_NET_PRICE,old.PIE_INVOICED_AMOUNT,old.PIE_UNT_CODE,old.PIE_HST_UNIT_PRICE, old.PIE_HST_TOTAL_QTY,old.PIE_HST_TOTAL_BILLED_QTY,old.PIE_HST_ALLOW_TO_BILL_QTY,old.PIE_HST_PRCT_OF_COMPLETION,old.PIE_HST_QTY_COMPLETED, old.PIE_PWR_ID,old.PIE_DISCOUNT,old.PIE_DOWN_PAYMENT_