Data

how to include a magik script in fme while extracting data?

Hi,I am using a reader to read the local .gdb file (around 11 GB) and write one of the feature classes into a Postgresql table. Reading is quite slow especially after processed 100,000 features, while the writing is at normal speed and is not an issue at all. So far, it already taken me around 10 days to read and write only 400,000 features into warehouse, still not finished.I assume it is because memory shortage, so I also disabled the feature caching. Anything else I can do to speed up the work? have been stuck for 2 weeks.

Hello. I cannot seem to run any workbench invokving a WFS. It seems to workan extent where it reads the get capabilities to give me the feature list but when i try to run preview or run the workbench, i get the error "HTTP transfer error: 'Couldn't connect to server'" We work behind a proxy but i have configured this in the s, and it works fine for wms, arcgis featur services. Just not WFS. the WFS service itself is fine, i can connect via other software such as QGIS just not via FME http://geoportal.ancpi.ro/arcgis/services/AU/AU_WFS_STEREO/MapServer/WFSServer?request=GetCapabilities&service=WFS Working on desktop 2019.2 Many thanks

Hello all, this question is related to question 83147, I have the same problem.  I use a generic reader and refer to the attribute values in the Excel file using the attribute dereferencer. This wiorked fine with my first tests. But now I have an Excel file which shows the columns completely at a different position than in FME!Excel: FME: The Kennung, in Excel the last column is the second column in FME. The specification to the service I provide via FME server is that the colum 1 and 2 in Excel (so 0 and 1 in FME) shall be used as X and Y. From what I see in Excel it should work but my workspace fails because the "Kennung" value is no valid coordinate. Any suggestions? I can't find a reason why FME changes the column order File is attatched:

We are unable to use the Oracle Non-Spatial reader to retrieve table schemas from the database. The error returned is as follows:Failed to obtain any schemas from reader 'ORACLE_NONSPATIAL' from 1 datasets. This may be due to invalid datasets or format accessibility issues due to licensing, dependencies, or module loading. See logfile for more informationUnfortunately that is the log file, so there is no further information. Oddly enough, once the workspace is generated it can be run perfectly fine and read data from the oracle database without error. We have tried Oracle clients 11.2 and 12.1 with FME 2017, 2018, and 2019 and all error. The Oracle Client has been correctly installed and works great from sql developer, arcgis, and other applications. There is also a TNS_ADMIN environment variable to the TNS names file and the client path is in the PATH environment variable. Additionally we are unable to retrieve SDE feature class schemas from the oracle database using the

 Hi All,  I have a workbench that takes an Intergraph Access Warehouse, massages it, and then writes to a Intergraph SQL Warehouse. In our environment, using windows authentication on the SQL DB, users only have permission to insert into the SQL DB.  In the workbench, I have 'Use Windows Authentication' set to 'No'. I then use a specific SQL logon that has full rights to the SQL DB.  When I run the translation, it fails with the following error log:   Using user supplied ODBC DSN 'ELP_Maintenance' as dataset Successfully connected to source dataset 'ELP_Maintenance' GeoMedia SQL Writer: Table 'ELP_UG_URDBox' has IDENTITY column 'ELP_UG_URDBox_ID' Database error: '[Microsoft][ODBC SQL Server Driver][SQL Server]CREATE VIEW permission denied in database 'ELP_Maintenance'.' SQL is: 'CREATE VIEW "FME_VIEW_1" AS SELECT [Asset_Status], [Asset_Owner], [Asset_InstallDate], [Asset_Acquisition], [Asset_WorkOrder_Install

Trying to make my life easier by setting up some Database connections in FME Server to help with updating workspaces, as I'm having to repoint them to a new SQL Server instance. So I'm trying to set up a named SQL Server connection using Windows Authentication. As expected, user and password fields are greyed out. But when I click on "OK", I'm prompted "PASSWORD is required". What am I doing wrong? Bug?

Hello, Iam looking for an Oportunity for IFC-Mapping. After working through a few Tutorials.Set other Strings in "Names or Descrition" is no Problem. Creating own Property Sets is possible too.But my Problem is the IfcMaterial Attribute/PropertySet.I got an IFC File which i can open in "Solibri" and Data "Inspector". It contained the Property layer Set "Material" and Identification Attribute "Material".After Running the blank Workspace both Attributes disappear.The AttributeExposer gives me these Opportunities but no progress here.or are the IFC-Writer settings the key? (Reprentations to Read?) I Want to write in Ifc 2x3. I hope you can give me a hint :)Thank you!Richard

I need to extract data from smallworld,from a collection(wire segment) I have an attribute (again a collection - Bay).I want to extract the data i.e., Id of wire, Id of Bay , Asset ID of Bay -- in the properties tag along with linestrings. Now I am trying to extract the data, but in the properties tag only the size of bay is displaying.Can someone please help me on that?

Hi,I have upgraded FME server on our test server (on prem, Windows Server 2016, express install, default install settings), using these instructions: http://docs.safe.com/fme/html/FME_Server_Documentation/AdminGuide/Upgrade-in-Place-Same-Machine.htm I took a backup of the FME config and tested it worked, which it did on 2018.1.1.1.After upgrading the server (version 2019.2.1, Build 19813), I tried to restore the backup but then it failed.It has this error: “Could not write FME Server request message. Connection may have been lost. An existing connection was forcibly closed by the remote host”I also noticed that the FME Server Core service stops during the restore and I have to restart it manually to get the server working again. I think the service stopping is the cause of the failed restore. I have tried restoring the backup pre/post licencing the server, running the services as 'local system' or as our specific account, multiple restarts and re-installs, but still no success.

HelloI want to export a table from PostGis databse by keeping only the columns that don't appear in a text file. This is an example to be more clear : Text_file : A B C ZTable columns :ID 7 T Z F K B         Export result:ID 7 T F K       Thank you in advance for your answers.Best Regards

I have a DWG file that I am needing to validate and one of the tasks is to assess the font.  1. How do I find out the font or fonts used in the DWG? Secondly, once I know the original font, I want to use that same font to write out the drawing using MapnikRaster. 2. How do I set the font and font size based on what is in the original drawing?  

Hi, good FME people!First post here, let's see if we can solve this.I am using a CSV reader to read all the files within a folder. [...\\rawdata\\*}], regardless of file extension.In the reader parmeter menu I am using the standard dataset parameter, feature type name from file name. I am noticing that not all files are getting through the reader. And by checking all unique fme_feature_types against what is actually in the folder it seems that duplicate filenames a skipped. The problem might be that there are duplicate file names, but in windows explorer, they are not considered duplicates as they have different extensions. Ie "1204NA.SND" and 1204NA.cpt"Is there a good solution for this? Thank you in advanceVictor

The query below works in Dataloader and the Pentaho Kettle tool. But the Salesforce reader ignores the Parcel__r.xx fields. I see where @schatt15 posted here saying he used Dataloader in his SF Reader. But I don't see any option like that in SF reader. I'm using FME Workbench in ESRI 10.7 FME(R) 2019.0.0.0 (20190328 - Build 19238 - WIN32)Thanks for your time.AllanSelect Parcel__r.MUSW__Street_Number__c,Parcel__r.MUSW__Street__c,  Parcel__r.MUSW__City__c,Parcel__r.MUSW__State__c,Parcel__r.MUSW__Post_Zip_Code__c,CreatedDate,NAME,Ordinance__c,MUSW__Status__c,  MUSW__Corrected_Date__c,GRASS_SQ_FT__C,Age__c,Code_Enforcement_Area__c,Safe_Clean__cFROM MUSW__Violation__cWHERE CreatedDate = LAST_N_DAYS:100

I have a problem with Path Reader in FME Server during Automations. I am quite new in FME Server, so maybe this issue is very easy.I would like to build automation with Directory Watch as Trigger - if file is creating or modyfing Workspace will run. Path to watch: $(FME_SHAREDRESOURCE_DATA)/Input.First part of my script, created in FME Desktop, depends on moving and archiving old data from $(FME_SHAREDRESOURCE_DATA)/Output to $(FME_SHAREDRESOURCE_DATA)/Archive. I built script in FME Workbench, wherein the Reader is PATH, and the Writer is file_copy.When I run this script with using Run Workspace in FME Server, everything is correct, old data are moved and new data are transformed and saved in FME Server Resources.But when I try to run it with Automation, something is wrong and in the log I can find the information:79Path Reader: Error opening the PATH Reader on folder 'Server\\resources\\data\\Output'. Could not find folder.80MULTI_READER(PATH_1): Skipping to next Reader81A fat

 Hi!,Can somebody tell me why I'm having a writing problem with GML? I have noticed that they are the only one having the property : Arc by centre pointAny clue to solve this problem? Thanks. 

Is there a way to take the data that is in an AutoCAD DWG paperspace and output it to TIFF / GeoTIFF keeping all the drawing settings from the DWG i.e. fonts, line weights etc. Basically I want to get an image that would be the same as if the DWG was printed from AutoCAD.

Hi, I have different DXF File with a lot of layers. I read them with the AutoCad DWG/DXF reader, filter and editing them. For the better handling I read the files as merged featuretypes, but I need at the end the data with single featuretype. That means I need all layers from the file and not the merged.How can I manage this with the Autocad DWG/DXF writer? Thanks and best regard

Greetings,I am writing a workbench in which I am supposed to read from an Arc SDE(oracle) database and writing all the contents in a File GDB. All the attribute names have their aliases in arabic which I need to replicate in the FGDB.I have checked the alias mode of the SDE reader to "Expose Aliases as Metadata" and the reader reads it but somehow it is corrupting the aliases in the output file GDB. Can anybody please help me getting through this. Regards,IMRAN 

Thanks for the heads up on that one question, @redgeographics - I think you're right. It's too much to expect anyone to answer with that much content. We'll see how they respond and we can keep an eye out for if they ask that sort of question too often (if they do we'll usually pass it on to their sales contact at Safe to suggest training or paying for consulting with one of our partners)

Hi.We're looking into producing some custom maps for offline usage on an iPad, and is looking at using the ArcGIS Explorer app for this.We do have access to ArcGIS Desktop, and to ArcGIS Online, but I would very much like to use FME to generate the map content.I've already uploaded custom map data to ArcGIS Online with FME, but maps for offline use require some "map package" (MMPK) files to be created and uploaded.Is this doable ? Has anyone attempted such a task with success ?Cheers

Hi,I am trying to build a KMLtour in FME so I can use it in Google earth. However, it is not working as I wish it did. First of all, from 3rd perspective it moves with a blink of an eye to the start position. I would like it to smoothly move to the start position. And secondly, it is "jumping" up and down, back and forth throughout the whole tour. What I really would like the KMLtourbuilder to create is to run it smoothly from start position to end position.Can someone please help me with this task? I will attach all my work in a zipfile and also the kml tour builder that may be open through google earth.

This is what I get when I write to a Spatialite database...: I don't know what's going on.Well it says there is no geometry mapping, but how is that? No geometry mapping entry found for 'fme_varchar(200)' in metafile 'C:\\Program Files\\FME2019\\metafile\\SPATIALITE.fmf'. Please visit http://www.safe.com/supportWorker 11036 > No geometry mapping entry found for 'fme_varchar(200)' in metafile 'C:\\Program Files\\FME2019\\metafile\\SPATIALITE.fmf'. Please visit http://www.safe.com/support

I have a obj file (200MB) and want to convert to cesium 3D tile. The FME converter is just change the format but i would like to apply LOD for the final 3D tile. is there any options in FME to provide tis function?

Howdy,Working with the Excel Writer, I am wondering if there is a way to have a sheet name of 31 characters and a named range of an additional 10-20 characters? A combined 31 characters does not permit very descriptive naming of sheet names/named ranges, if I'm completely missing something or someone has a suggestion for a work around I'd love to hear it. Background The writer’s General Parameters Sheet Name text box is limited to 31 characters, which makes sense since this is the designed maximum length for a sheet name. Reading the FME tutorial "Using a Template File when Writing Excel Data" there is no mention of character limitations.FME's character limitation becomes an issue when writing to a named range, both the sheet name and named range are entered into the the same text box separated by a "/". Due to this, where the combined total characters exceed 31 the extra is trimmed off (e.g. sheet name & named range of "DataSummary_FMEoutput/