Using readers and writers to extract and load data.
Recently active
Hi,A dinosaur has raised its head from the tar pit! We've been given a set of Paradox data tables to import.As far as I remember, it was something that the long-time retired Borland Database Engine (BDE) could access, but how do you read such data in this day and age (if at all) ? Preferably directly with FME of course.I was happy to find a Paradox ODBC driver from Microsoft in my Windows, but it doesn't seem like it's capable of reading any of the provided table files (DB, and MB) :-(Do anyone here have any insights on this issue they want to share ?CheersLars I.
Hello FME community, Can someone help me with this error message on FME Server ?"Excel Reader: Failed to open dataset '<filepath>'. Error message was: 'damaged or not a zip file.'I run a workspace on FME Server which reads an Excel-file (.xlsx), but FME Server reports that the input Excel file is zipped or corrupt. Although, the Excel file exists on that particular location and is not corrupt or zipped. The file is published with the workspace so it's on the same directory on server.I don't get this error when I run the process on my local computer.Dries
Hi,I am trying to set the Writer Destination folder to dynamically or automatically set to the location of the Reader Source folder but I am not having much luck.I thought the easiest approach would be to use the FilenamePartExtractor and set the _dirpath as the attribute value or user parameter of the Destination folder but it doesn't work.Does anyone know the best way to set these parameters in FME?ThanksAndrew
Hi, I'm simply trying to write a summary list of the layers used in all dwgs in a folder to excel. The workbench will do this to inspector but not xls but I can't figure out what's going wrong, any hints?
Hello,I am trying to read or write the various text attributes such as "Title" or "Comments" listed in Microstation under File -> Properties. I have checked all format attributes in my DGN Reader as well as trying different reader parameters to get the attribute to show up in my inspector - no luck so far.Is there some way to read these as FME attributes?Thanks in Advance
I am attempting to write lines and polygons to an SDE annotation feature class. If I create the annotation feature class without a custom field this works fine. But, if I add any custom field to the annotation feature class FME crashes when its starts writing. I am using FME Desktop 2016.1.1.0 build 16609 32-bit if that makes a difference.I did the same operation but writing to a File Geodatabase and get the same result.If the input data is annotation instead of lines or polygons writing to custom fields works fine.Any trick to get this to work? Is this a known issue?
Hello,Lets say I have given JSON structure being passed to FME workspace as a published parameter value:{ "users": [{"user":"John", "age":"33"} ],"otherParameters" : [ {"name":"parameter1", "value":"NULL"}, {"name":"parameter2", "value":"NULL"}]}It may contain different users and otherParametersI would like to add a transformer/tester at the begining of the workspace flow so that if in the json there is a user with the name John and age 33 then do some things and if tha age is different or for example users list is empty do others.What would be the best approach to do that? Thanks in advance.
Hi,I am producing GML files from FME, but the writer automatically includes xmlns:xlink="http://www.w3.org/1999/xlink" attribute on gml:FeatureCollection element.Can I remove this attribute from writer?Thanks,Ashish
Some UNC paths are very long (\\global\analysis\more\another\and\so\on\...), so it might be necessary to map the very long path to a drive letter for example. How can I do this and retain transportability across Windows platforms, and maybe other platforms?At the moment I use a SystemCaller, and simply assign a drive letter I pick to the UNC path, e.g., SUBST X: \\global\analysis\etc\.But, this is possibly going to be wrong at some stage, when X: is assigned by the admins without warning, well, maybe. In Windows there are various ways to get the next unused drive letter, one of which is PUSHD \\global\analysis\etc\but, then how do I get the drive letter that is assigned, using the system caller?Or, is there another way?
Is there a transformer for stripping HTML from text? I see the HTMLStripper, but it appears to replace HTML with XML. I want all HTML tags removed, including the <!DOCTYPE html>.Thanks
Hi,I have two xml files, the first one is made with these informations:The second one is made with these information : My problem follows:1 - I have to put the element <TIMSH> present in the second file in the first file at the same place (same <ASE id>. How can i proceed (for 1 <TIMSH>)2 - I can have many elements <TIMSH> present in the second file for one <ASE id> and i have to update them in the first file at the same place. How to proceed ? (many <TIMSH> to update)3 - The tree structure is : <ASE><ATT><TIMSH>Thanks for your help
Dear community, I have difficulties understanding the behavior of server handling (unc) paths. I'm quite new to server so this one might be simple but I don't get it.What I want to do is use a Directory Watch publication on a upload folder. Then let a workbench subscription react to a new upload. This works. I need the workbench directory file and pathnames reader to scan the upload folder, add the new files to a list and move the files to a queue folder.This is where the trouble comes in. The log tells me that the folder is not found. But the path is not the path I defined (\\\\fc01\\FMEdata\\KLIC\\upload) but local (D:\\Program Files\\FMEServer\\repositories\\KLIC\\01_scan\\upload).When I create the path dynamic (datapath = \\\\fc01\\FMEdata\\KLIC, dataset = @Value(datapath)\\upload) things works fine. So I got it working but I do not understand why... Can anyone give me a hint in the right direction?I know for sure server has read/write acces to this path as I have no proble
I have a transformation from Oracle Non Spatial to Salesforce that works fine until there are more than 200 records. At that point it errors. I can't tell from the error message what the issue is exactly. Is it some setting in Salesforce? Do I not have the parameters set correctly on my Reader/Writer? Any help would be appreciated. I do know that the records after 200 do not have data issues as I can write them only not when they are greater than feature 200.Salesforce Writer: Record 201 was not processed successfully: 'CANNOT_INSERT_UPDATE_ACTIVATE_ENTITY:InternalServiceOrderTrigger: execution of AfterUpdate caused by: System.NullPointerException: Attempt to de-reference a null object Class.InternalServiceOrderTriggerHandler.emailRelatedServiceOrderSDC: line 668, column 1 Class.InternalServiceOrderTriggerHandler.triggerHandler: line 93, column 1 Trigger.InternalServiceOrderTrigger: line 4, column 1:--'
I'm still quite new and struggling on the first hurdle, any help anyone could provide would be much appreciated. I have a CAD (DWG) file with multiple Layers. The Layers contain settings such as Linetype, Lineweight, colour etc. I would like to get the Layer setting out to and Excel spreadsheet.I've opened a CAD file, exposed only the relevant Layer attributes but nothing seems to flow through to the transformers or even into an inspector.
Hello, is it possible to write date to Excel dynamically (as it happends with Shape-file)? Without writing the Name of the output at the begin? I wonder if there is any Workaround to do it? In my case i Need to write Information in different Excel-Files with the Name of variable (depends on class of the data).
Hi,this might be odd question but here it goes:Is it possible to explode hatch paterns to its geometries. For example, if some polygon is hatched with horizontal lines can I get those lines?Thank you.
I'm trying to figure out how to access the FME_MacroValues['FME_JOB_ID'] system parameter. I'm trying to link this script to a writers destination. Basically want to include the job ID in the file name of the output. I've attempted this using the code below but am getting the error shown in this log:Starting translation...INCLUDE -- failed to evaluate Python script `def ParamFunc(): import fme return '\\\\ServerLocation\\logging\\failed_logs\\' + 'failed_load_' + FME_MacroValues['FME_JOB_ID'] + '.xlsx'value = ParamFunc()macroName = 'DestDataset_XLSXW2'if value == None: return { macroName : '' }else: return { macroName : str(value) }'Program TerminatingTranslation FAILED.Traceback (most recent call last): File "<string>", line 5, in MF_Include_1490921734471 File "<string>", line 4, in ParamFuncKeyError: 'FME_JOB_ID'This is the python code:import fmereturn '\\ServerLocation\\logging\\failed_logs\\' + 'failed_load_' + FME_MacroValues['FME_JOB_ID'] + '.xlsx'
I am using an aggregated object to insert a cell using the dgnstyler. The aggregated object has 2 geometries, a point and a line. I need to use the line as a reference for the angle of the cell rotation, but I do not know how to derive an angle for this line. Can someone help me find a way to do this?
I'm using the Esri Geodatabase (ArcSDE Geodb) reader with Feature Read Mode set to Metadata, to read in GEMINI metadata from SDE. I'd like to manipulate certain elements before sending the updated metadata back to the SDE feature class. Using the XMLUpdater I've been able to amend the content for some elements, however I haven't had any success when trying to amend the revision date, as there are three different date strings all with the same XML path: metadata/gmd:GEMINI_Metadata/gmd:identificationInfo/gmd:MD_DataIdentification/gmd:citation/gmd:CI_Citation/gmd:date/md:CI_Date/gmd:date/gco:DateCurrently none of them are getting updated on the output XML. The different date types are differentiated in the gmd:dateType element, e.g: <gmd:dateType> <gmd:CI_DateTypeCode codeList="http://standards.iso.org/ittf/PubliclyAvailableStandards/ISO_19139_Schemas/resources/Codelist/gmxCodelists.xml#CI_DateTypeCode" codeListValue="revision">Rev
Hello, I've searched all available online sources but none appear to have this issue.Very simple task: I've added an Oracle Spatial Reader, connected to desired table and now want to extract x/y but I get this error when running."Error - Cannot have NULL value for 'z coordinate'"I've looked at the table in Oracle developer and indeed the Z values are Null.I'm aware that this table has multiple Spatial columns so I've checked: Handle Multiple Spatial Columns: YesI've tried a SELECT statement to run before translation:SELECT c.GEOM.SDO_POINT.X AS X, c.GEOM.SDO_POINT.Y AS Y, FROM A.ENTITIES c WHERE ACCESS_CODE = 'O'I've tried to expose the attributes: oracle_sdo_point.x oracle_sdo_point.y oracle_sdo_point.zIs there a way to force this to 2D rather than looking at the Z values?Any ideas appreciated.
When loading a 2016.1 Workspace in 2017.0, I saw this in the Translation Log:Workbench: Workspace integrity check during load found one or more readers/writers with configuration issues.Workbench: Backed up current workspace as: X:\\Path\\Folder\\Wibble (backup).fmwWorkbench: Fixed reader/writer configuration issues.How can I find out what was wrong with the Reader/Writers?
Probably a simple solution to this but I can't seem to find it.If I have a generic writer and I want to write out to dwg or dxf how do I enforce it to write to dxf, it defaults to dwg . I have tried lots of things like creating a dummy writer for ACAD or creating an output published parameter with 2 options for the AutoCAD writer with 2 different values-- this works but if I select DWG or DXF I still get a dwg file.I can add a tester which sorts whether the end user selected DWG or DXF and then filters it into an ACAD writer that has the extension hardcoded..but I don't really want to do that when I feel like I have just missed something? Any help would be appreciated
When translating text nodes into Microstation I have found that the linkage is not being created during the translation. Once the dgn is created I must select the text node and edit it before the linkage shows up. This is an issue when I need to project the data into a different coordinate system because the text nodes end up in a different location then everything else. Is there a way to have the linkage created during the translation process?