Using readers and writers to extract and load data.
Recently active
Hello,Is there a way to filter "Start Time" field in Ascending / Descending order or any other fields for that matter.I have too many tasks scheduled and it's hard to find the right "start time" slot.On a different note (Not sure if it's the right place): My test/live site is now fully functional and FME Data driven including the HTML Outputs / Layers update... Notification service, which will soon be provided to residents, makes use of FirmStep but the delivery of the notification service is FME at its best!! The other bits rely on Open Source (PostGIS / QGIS...) Basemap = work in progresshttps://molevalley.cloudmappin.com/mmv/ (Not a molevalley.gov.uk domain name because of hosting issue due to time constraint) Thanks and hope you like it. I also take this opportunity to thank the community for their assistance as I've managed to complete my project (well almost).Kind Regards Sameer
Hi,I have an Excel spreadsheet that has thousands of rows that need to be grouped by a couple of columns/attributes, then each grouping written to their own respective fan-out spreadsheet. I've accomplished creating reports by using the HTMLReportGenerator, then writing each report to an emailer. So, I need to accomplish what the ReportGenerator can do - group by attributes and create tables - but I need the results written to either individual spreadsheets or as tables in individual Word documents. Any ideas on what Transformers will give me the grouped Features to write to individual files?
Hi,I have an Excel spreadsheet that has thousands of rows that need to be grouped together by a couple different columns, then write all grouped Features to their own individual spreadsheets. I've done this using the HTMLReportGenerator, then putting the HTML content table into an email, but I need to instead write each 'report' in a spreadsheet, so each table row would be an Excel row. Can anyone help with what transformers would be able to group the features without analyzing them, then write each grouping to their own respective fan-out spreadsheet?
i have dgn file that include map for a place ,as first step when i put this file in fme which properties should i adjust to work on it , and also i need to get lines from this file and polygon to check intersection between lines and polygon.so what should i do ? thanks for help
Hello,I am creating dwg files using autocad template and DWG Styler. But when I opened the file in AutoCAD I am not able to see the linetype, instead it shows solid line. But as soon as I execute command REGENALL the linetype is displayed correctly with linetype.I have set autocad_linetype_generation=1 in fme, The scale is also fine, also I could manually create the linetype in autocad,I have done everything as mentioned in this post https://knowledge.safe.com/questions/83076/enable-linetype-generation-for-dwg.html I dont know if this is FME issue or AutoCAD setting issue.Has any one observed this or has any suggestion? Regards
Hi All, I have a workspace published to FME server with a few MI tab readers, nothing special. (read several MI tab files-> manipulate attributes -> extract coordinates -> output to CSV). For whatever reason when the job runs per its scheduled time, It fails with the following error in the log:MITAB Reader: Failed to open and parse file 'E:\\ProgramData\\Safe Software\\FME Server\\repositories\\Workspaces\\SSALocator\\RUR_ADS_PROPNUM.TAB'. Make sure that the file exists and is valid The tab file is located on a network share so i'm not sure why its referencing the location above? Theres no files here other than a copy of the workspace. It doesn't have a long path name (>260) If i manually click resubmit job, it works fine so i don't believe its file access(I used the full UNC path for the readers). Any suggestions are appreciated.
Is there a way to set the justification of text in a PDF writer? I can't find anything in the PDFStyler transformer or any Format Attribute in the writer to control this and this article doesn't mention PDF. https://knowledge.safe.com/articles/16546/text-justification.html The text feature class I'm reading from has the text justified as center, center, but when I write to PDF it shows up as top, right in relation to the anchor point.In GIS:In PDF:Any one have any ideas?
Hello,I have FME 2018.1 and PostgreSQL 9.4.I try to create a reader with non spatial date so I could join them with spatial data but it seems FME can't reader the features in the non-spatial table.I tried to open it in the Inspector but it doesn't work too: Opening POSTGRES reader for dataset 'cadastre_2019'PostGIS client encoding: 'UTF8'PostgreSQL 9.4.0, compiled by Visual C++ build 1800, 64-bitSuccessfully closed POSTGRES database readerSuccessfully closed POSTGRES database readerMerged 1 schema features read from 1 datasets into 1 resulting feature typesSaving spatial index into file 'C:\\Users\\J\\AppData\\Local\\Temp\\FFS_1579770320565_8204_DATA.fsi'Finished saving spatial index into file 'C:\\Users\\J\\AppData\\Local\\Temp\\FFS_1579770320565_8204_DATA.fsi'Removing dataset 'cadastre 2019 [POSTGRES]' from View 1Successfully closed POSTGRES database readerThe dataset 'cadastre<space>2019' was closed successfullyThe 'P
Hi folksI created a "choice multiple (with alias)" parameter, for several writer's format (MID-MID, DWG ...)and I would try to use with a Generic Format Writer, for instance, to produce a DWG and a MIF-MID simultaneously.when I choose more than one format, it do not work.Is it normal ? I attach the workspaceregards
I have built a workbench that takes a shapefile (which isn't one file) as an input. I've published it to FME Server. How do I upload a shapefile(s) so that FME Server will process it?
I have a series of feature readers that read data and schema from a postGIS DB and writes to a GDB using a dynamic writer and the schema feature generated from the Feature reader (see image). For some data I have empty tables and FME does not seem to write the corresponding feature class in GDB if no features are found. Now, what I would like to achieve is to force FME to write every feature class (corresponding to a table in the DB) even if the table does not contain any data. Ideally I would need an empty feature class with one row and empty data but also an empty feature class is fine, as long as there is the schema, that would be the requirement. Is it easily possible to achieve in FME desktop?
I am getting the following error message when I try to connect a reader to a read-only Arc SDE connection "Unable to read from the table/feature class 'GDM.GasValve'. If 'GDM.GasValve' contains a class extension, make sure it is registered on this computer"I would appreciate if i can get any help with getting round this.
I would find it helpful if it's possible in FME Desktop to search for a line that has id in my map (shape file ) ,if find it .so check the data and do something if not so do something else .could i ask ,which type of transformer could i use for search in the map for data but iam not sure if my map will has this data or not ,just for check .
Hello to the whole FME community! I have a very simple and basic question to ask you.I work with large volumes of hydrographic data, address data, etc. and soon lidar data.With each treatment / test I perform, my files often duplicate and it becomes easy to get lost in this mountain of data. So I would like to have your opinion on the advantages that I would have to use a database management system (PostgreSQL with the PostGIS extension) For now, I think that this would allow me to: - better manage the storage and versions of my files- optimize the transitions between my files and FME (by directly connecting my DB in FME)- increase the speed of loading and writing my data- get my data instantly in QGIS (by also connecting my DB in QGIS)- to decrease the storage space of my files given that they will no longer be stored in shapefile (+ dbf + shx)? Tell me if I'm wrong, and if you have other advantages to list me, I'm interested! :) Thank you !
Hello, i'm pretty sure it's a simple problem, but somehow i'm not able to write a 3D shapefile. Every time I look at the feature information in the Data Inspector, I get "2D" as the dimension. But I need "3D" as dimension. As a test, I have written the script below. After I have created a "test point", I create an attribute with a height, which I write into the Z-value using the 3DForcer. When exporting I want to write a 3D shapefile, but I have some kind of error and I can't see the forest in front of the trees anymore. Thanks a lot for the help
Hi! I'm using FME 2019.1 with INSPIRE Solution Pack and I'm trying to write an INSPIRE Administrative Unit GML from a shapefile (SHP) that contains some multipolygons. The problem is that the resulting GML does not contain the multipolygons geometries (but the features).SHP (reader) GML (writer) To assign values to the GML fields related to GeographicalName, I use 2 aggregators: one to generate the list "GeographicalName.spelling" and another to generate the list "name", both of them grouping by UUID.However, when doing the same (from the same SHP and using the same transformers) to write an INSPIRE Geographical Names GML, multipolygons are included.Is there maybe any issue with the INSPIRE Administrative Unit GML schema?Comparing the resulting GMLs, Administrative Unit vs. Geographical Names, I see that the first one does not have a MultiGeometry tag.Thank you so much,
I am reading from oracle spatial table and writing to Mongodb. once I written to mongo with some sample data, and i want to re run my fme script again for whole, by drop and create method(mongo db collection). I set the writer option to "drop and create", but its giving error. error msg saying thatMONGODB writer: Layer layerDataPolygon already exists, CreateLayer failed. Use the layer creation option OVERWRITE=YES to replace it.(red color)where to set OVERWRITE=YES(layer creation option) ? as per fme's error msgCan anyone pls help?
Since upgrading to FME Desktop 2019.2.2.0, when I run FME workbenches with excel readers I get the warning:"Excel Reader: Sheet 'mysheetname' has invalid value '' for parameter 'xlsx_start_row'. Parameter will be ignored""Excel Reader: Sheet 'mysheetname' has invalid value '' for parameter 'xlsx_end_row'. Parameter will be ignored" I never got this before, previously i was running 2019.1.3.1. What does it mean and is it a problem?
ok. so there have been a lot of questions about running a workspace through the task scheduler (and the fact that it doesn't work) with running it manually.I have tried all the solutions suggested.Problem:I have a workspace that logs onto an AGOL account, retrieve the data and create an excel.I have no problem running this workspace manually when I am logged on to the server.The issue is when I schedule this to run using a service account. I get this error:ArcGIS Online Feature Service Reader: Connection 'Esri ArcGIS Online' does not exist. Check connection parameter and connection definitions in FME options and try again Solutions I've tried:(moving the data and publick key into a public location) https://knowledge.safe.com/articles/34678/making-database-and-web-connections-public.html(editing the registry) https://knowledge.safe.com/articles/32356/scheduling-software-doesnt-recognize-fme-connectio.htmlset the task to run with highest privilegesset the "Start in&q
Hi,I don't know much about FME, but there is no ESRI support for S57 Data to get a GDB without getting more expensive Tools. So I found a model of FME Workbench from rylanatsafe (https://knowledge.safe.com/articles/570/s-57-enc-hydrographic-data-format.html)But when I run that model,I get the Error:"Could not create a GEODATABASE_MDB writer. Personal geodatabases are not supported with 64-bit versions of FME and ArcGIS. Plugin 'GEODATABASE_MDB' was loaded, but a writer could not be created. Error was #1: A fatal error has occurred. Check the logfile above for details"Is there any way out? So I need the s57 Data as a GDB with the symbologie of s57 data. (ENC) Thanks for attention.
It is only possible to rotate text (fme_rotation; or set idgs_rotation to 0) if the text is splited (split multi text - reader parameter).If the text is splited, there are additional point and line features (with length 0) in the output drawing (looks like the insertion point of the text; see attached picture).Is there a way to rotate the text without the additional objects.
Is there a way to 'IGNORE_UCS' when reading in dgn files? I have heaps of dgns with different user set coordinates systems. The dwg reader has this option but I can't see a way to replicate this setting for dgns.Just to clarify - the dgn are in UTM but each dgn file has a localized UCS set by the designer.
Hi, I have a column named DateTime in a table. The format of date and time is as follows: 9/9/2009 21:23:31 25/12/1991 8:3:23 means There is a space b/w date and time. Date Month Year is seperated by '/' and time by ':' Now, I need to seperate date and time. I want two new attributes Date and Time with respected outputs. Thanks in advance.
Hi Fme:ers, I have a problem inserting data into PostGIS with FME2013. Sometimes it fails after 500 000 objects and sometimes it occur after 5 000 000 objects. Feels like a server/network problem but cant figure it out. Anyone experienced this? 2013-03-01 14:51:07| 102.1| 0.3|ERROR |Bulk copy failed on table 'public.Infra_import' using delimiter ':'. Error was 'server closed the connection unexpectedly This probably means the server terminated abnormally before or while processing the request. ' 2013-03-01 14:51:07| 102.1| 0.0|ERROR |A fatal error has occurred. Check the logfile above for details 2013-03-01 14:51:07| 102.1| 0.0|ERROR |A fatal error has occurred. Check the logfile above for details 2013-03-01 14:51:07| 102.1| 0.0|ERROR |Bulk copy failed on table 'public.Infra_import' using delimiter ':'. Error was 'no COPY in progress ' 2013-03-01 14:51:07| 102.1| 0.0|INFORM|Successfully closed Postgre
Hi I am trying to wrote the values of new excel rows to a sharepoint list online but I get the following error "Microsoft SharePoint List Writer: Client-side error: '405 Client Error: Method Not Allowed for url: https://sharepointsite/_api/contextinfo' returned from SharePoint. Error message was: 'The HTTP method 'GET' cannot be used to access the resource 'GetContextWebInformation'. The operation type of the resource is specified as 'Default'. Please use correct HTTP method to invoke the resource.' " I read elsewhere that this was resolved previously by an update. Any idea of a work around or anyone else know how I can resolve so I can use as an automation on FME Server?