Using readers and writers to extract and load data.
Recently active
HelloI use a ORACLE non spatial writer (shortname ORACLE8I_DB), non-dynamic i.e. fixed definition of attributes. One of the attributes is defined as: HSN varchar2(10)If I use this in my environment and if the attribute HSN is longer than 10 it gets written without any error or warning and is cut to length 10.Problem:If a customer in a different Oracle environment uses the same workspace with the same data the writer stops with ERROR complaining that the value is too long.One time it cuts the data without any message, the other time it stops with ERROR.Does anyone have an idea what maybe the reason for the different behaviour in the Oracle environments ?Our Oracle expert says there is no option in Oracle to control this. Google didn't help either ...Thanks for any hintMichael
Hi,I have a workspace that reads some data and after some processing it writes the data via feature writer inside an postgis database. Afterwards more sql scripts are triggerd via sql executors. At the end all data is read again for final writing via FME.The problem is that the time increases exponentially when the processed data becomes larger (taking a few hours to a few days).In the processing part I can split my data into smaller parts and write this data in multiple schema's in postgis. The problem is that I can't run the next sql scripts in parallel on the X amount created schema's. If I trigger every script x times, this triggering is done sequentially and timing remains the same.If I try to put the longest script into a separate workspace runner, I can only run this WSR in parallel when I say that it should not wait for completed job, but then I have an issue with the latest step (= combining all data from X schema's into 1) as the table is not yet existing (or
Hello,I am currently working on extending the IFC Schema for infrastructure. I have designed graphically (EXPRESS-G) the proposed changes and I am wondering whether it is feasible to embed the new classes in the existing FME Writers, or create new FME Writers with the properties of the proposed extension.I have accomplished a similar thing when I wanted to create some extra writers for CityGML via the environment of FME Workbench, but I am pretty sure this is slightly more complicated.Thank you for your time.Kind regards,George
Hi,We have been using FME to write updates to our hosted feature layers on AGOL for some time. Lately the process has been failing with this error message: "ArcGIS Online Feature Service Writer: 'updateResults' error for a feature in 'Schedule of Native Title Determination Applications'. The error code from the server was '1000' and the message was: '24301: Expected a call to BeginGeometry(Polygon) or EndGeometry, but BeginFigure was called." Has anyone seen this, have any idea what the problem might be? Thanks
I have classified LAS-data to get high vegetation. I now need to get tree position for the center point of the point clusters (every cluster is one tree).I want one point for each tree with z(height) attribute, to construct a base for generating at tree model of our city. How do I manage this in FME?Best regards, Tobias
I want to get my textured MP models into Revit while keeping the texture. Is this possible somehow? I tried going through IFC first, but color is all I managed to get to transfer. Are textures even possible? I'm also open to other ways of getting the models into Revit. Only geometry is fine too, the attributes are currently irrelevant.
Is there any way to put all writers into one transaction so that it only commits the changes when there is no other work left to be done by the workspace, i.e. performs a rollback on the database on a failure outside of FME?More details on the matter:I have a workspace with one input file and multiple database writers that update seperate tables (Oracle non-spatial). I want to be absolutely sure that eitherway ALL features are written, or none at all on failure. How to achieve this?Because the current situation is as follows:Workspace fails with database or network error Some tables are updated (those that came first) and some tables aren't.We tried using a SQL Executor as one of the first steps, to execute 'set transaction read write', hoping there would be one commit for all database writers or as one of the last steps of the workspace.This works when the workspace fails with a Terminator transformer, but when the translation failes with a database error instead (for exam
Creating a drawing from shapefiles but my block attributes are merge all together.I have several blocks are being created by fme. The Attributes for all the blocks are being merge to every different blocks. I think when i setup my writer for autocad is not correct. What is the correct method on creating block with AutoCad drawing without merge all block attribute together?TMT-1132.jpg show block create by Autocad Insert method.FME-TMT-1132.jpg show block create by FMEFME-WRITER-AUTOCAD.JPG example of my writer
Hi everybody, I am trying to figure out how to write metadata to ArcGIS Online Feature Service (update existing). I am able to read metadata from SDE using the "geodb_metadata_string" format parameter when setting the feature read mode to "Metadata" on the reader, but not being able to write to ArcGIS Online. Is this even possible? ?Thank you.
I'm doing a fairly straightforward IFC conversion. It runs once correctly and then every time I try it again, it errors out with the below messages. When I create a new writer it works, but also only once. What's up with that?Dataset template source `<Unused>' for writer GEODATABASE_FILE_1 could not be located Dataset template source `<Unused>' for writer GEODATABASE_FILE_1 could not be located f_72(CreationFactory): Dataset template source `<Unused>' for writer GEODATABASE_FILE_1 could not be located Dataset template source `<Unused>' for writer GEODATABASE_FILE_1 could not be located
I create Point Clouds from Drone photography using Pix4D. It outputs both .XYZ and .LAS files. Pix4D also generates contours but I am not satisfied with the output - it's too generalized. I want to create highly detailed contours from the Pix4D point cloud output. I also want to optimize them with the FME Curvefitter transformer and output to an AutoCAD DWG. I have tried several processes using the PointCloudXYZ reader and also the PointCloudCoercer but have not been successful creating an AutoCAD Polyline output that can be Curvefit. Can you give me some pointers?
I have a spreadsheet with two worksheets (sheet1 and sheet2). I have a second spreadsheet which lists all the records that need to be removed from both worksheets, the new edited output will be in sheet1_v2 and sheet2_v2.How would you advise I move forward with this?Many thanks
HiI have a workspace that extrudes texture files (appearance) from my CityGML buildings, puts them together and creates a simple single texture atlas image file to improve performance when viewing the photorealistic model. The source CityGML file is a textured building with multiple texture image files, one image for each surface. The problem is that FME's CityGML writer always writes by default it's "own" appearance module (if the source file had textures) to the output CityGML file and copies the texture coordinates and imageURI parametres from source, which in this case is a CityGML file with a reference to multiple texture files instead of one texture atlas raster image. I only want to modify the existing appearance module, which i managed to do, but the writer still writes out appearance module to the CityGML file. As a result i have a CityGML file with two different appearance module where the other module references to my newly created texture atlas image with
This is just a quick note to inform you that we will be releasing a new search tool for the Knowledge Center in the next 1-2 weeks.Built on the Coveo platform, this tool includes a machine learning component and will auto-tune results and rankings over time to ensure users are receiving the most relevant results based on queries and clicks. We will also be adding more sources in the near future and have plans to roll this out across our other websites in time.A preview is available now at https://search.safe.com/ and we’re looking forward to seeing some real world data in the system. When we officially release, the search will be integrated into the main search field across the Knowledge Center, but for now we’d appreciate it if you could click over and give it a try.
As I have seen in https://knowledge.safe.com/articles/1070/thinning-and-combining-point-clouds.html It is possible to do points cloud thinning in FME. My problem is that I don't want to thin them by any of offered possibilities. In places with similar altitude, I would like to delete more points, and in places with higher elevation differences I would like to keep more points. For beginning I am extracting coordinates but I am not sure how to use that for filtering and thinning the las point cloud. Thank you all in advance for all the help.Dejan
When I attempt a simple conversion of a MrSID file to an ECW via a reader and writer (something I've done successfully many times) I am getting the following results/error: Command-line to run this workspace: C:\\apps\\FME\\fme.exe C:\\Users\\DOUGBL~1\\AppData\\Local\\Temp\\wb-xlate-1519219239276_15664 --SourceDataset_MRSID "C:\\MapData\\Williamson County\\SID\\Williamson_Co_2014.sid" --DestDataset_ECW "C:\\MapData\\Williamson County\\ECW" Starting translation...FME 2016.1.0.0 (20160419 - Build 16492 - WIN32)FME_HOME is 'C:\\apps\\FME\\'FME Professional Edition (node locked-crc)Serial Number: H8U9-DF32-16TZPermanent License.Machine host name is: DESKTOP-5NGB2S9START - ProcessID: 14816, peak process memory usage: 29096 kB, current process memory usage: 29088 kBFME Configuration: Command line arguments are `C:\\apps\\FME\\fme.exe' `C:\\Users\\DOUGBL~1\\AppData\\Local\\Temp\\wb-xlate-1519219239276_15664' `LOG_STANDARDOUT&#
I have an ~80gb file that i need to split into around 15 files geographically into 25x100 strips. https://knowledge.safe.com/articles/1100/tiling-point-cloud-data.html is helpful but FME will still read the whole file in one go. i only have 16-32GB of RAM (depending on computer im using) and so the computer will fall over. how can i split this file geographically and get around FME reading the whole file in one go?
CREATE OR REPLACE TRIGGER invoice_before_delete BEFORE DELETE ON prj_invoice_work_exe FOR EACH ROW DECLARE v_username varchar2(10); BEGIN SELECT user INTO v_username FROM dual; INSERT INTO prj_invoice_work_exe1 ( PIE_PIN_ID,PIE_TDT_ID,PIE_ID,PIE_QTY_EXECUTED,PIE_UNIT_PRICE,PIE_NET_PRICE,PIE_INVOICED_AMOUNT,PIE_UNT_CODE,PIE_HST_UNIT_PRICE, PIE_HST_TOTAL_QTY,PIE_HST_TOTAL_BILLED_QTY,PIE_HST_ALLOW_TO_BILL_QTY,PIE_HST_PRCT_OF_COMPLETION,PIE_HST_QTY_COMPLETED, PIE_PWR_ID,PIE_DISCOUNT,PIE_DOWN_PAYMENT_RECOVERY,PIE_BOQ_DISCOUNT,PIE_BOQ_DOWN_PAYMENT,PIE_UNT_PRICE_BFR_DISCOUNT, PIE_TOTAL_PRICE_BFR_DISCOUNT ) VALUES ( :old.PIE_PIN_ID,old.PIE_TDT_ID,old.PIE_ID,old.PIE_QTY_EXECUTED,old.PIE_UNIT_PRICE,old.PIE_NET_PRICE,old.PIE_INVOICED_AMOUNT,old.PIE_UNT_CODE,old.PIE_HST_UNIT_PRICE, old.PIE_HST_TOTAL_QTY,old.PIE_HST_TOTAL_BILLED_QTY,old.PIE_HST_ALLOW_TO_BILL_QTY,old.PIE_HST_PRCT_OF_COMPLETION,old.PIE_HST_QTY_COMPLETED, old.PIE_PWR_ID,old.PIE_DISCOUNT,old.PIE_DOWN_PAYMENT_
I'm trying convert Census block shapefiles (see link: https://www.census.gov/cgi-bin/geo/shapefiles/index.php?year=2017&layergroup;=Blocks+%282010%29) into KMLs that can be opened easily in GE. The Census Bureau has readily available state-by-state KMLs for tracts and block groups, but for blocks (the smallest unit), they only offer downloads in the form of very, very large shapefiles. Any suggestions?
After reading the metadata from SDE, the geodb_metadata_string has been updated along with a new geodb_type attribute set to geodb_metadata. How to configure the FeatureWriter or ArcSDE writer to accept metadata changes.
How can I expose the "table name" parameter in the dialog box of the Oracle reader as an attribute I can use in a writer (to force it lowercase)?
I would like to try translating an ArcGIS layer file generated in ArcGIS 10.5 (32bit version) into MapInfo format using FME 64bit version however, the option is greyed out and the only reason I can relate this to is that the ArcGIS I am running is 32bit? Is there a way around this or should I try downloaded the FME 64bit version. I currently only have a trial license because I want to work out if this works before we buy a license. Regards Sandi
Hello,Is there a way to convert LiDAR Cloud Point (.las) to DEM Raster With Spectrum Colors Based On Elevation Values?I see the following post (https://knowledge.safe.com/articles/1345/creating-a-raster-from-a-point-cloud.html), but just hope the expert may show me how to colorize the raster image with Spectrum Color like following image:Thanks a lot,Reno
I need to create a single shapefile file involving the 3 polygons like the one in the image below, how can I do it?
Hi All,I have a customer who has enquired if FME Server can be used to validate document templates within SharePoint and be alerted when a new document is uploaded. I don't have the customers full list of requirement but in advance of the meeting I was wondering has anyone done anything like this before in SharePoint?