Since last night, our processes have been running on a fault. Apparently something is no longer working with the external tables. Jobs that use external tables (Redshift Spectrum) as table input show the error "no columns provided". Any ideas?

Matillion ETL
1

Error Log:

20-Nov-2022 07:46:25.256 SEVERE [task-thread-1-2] com.matillion.bi.emerald.component.validation.ValidationWatcherHelper.process Failed to process validation watcher helper

   java.lang.reflect.InvocationTargetException

      at sun.reflect.GeneratedMethodAccessor527.invoke(Unknown Source)

      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

      at java.lang.reflect.Method.invoke(Method.java:498)

      at com.matillion.bi.emerald.component.validation.ValidationWatcherHelper.process(ValidationWatcherHelper.java:75)

      at com.matillion.bi.emerald.shared.component.implementation.ComponentParamImplementation.validateComponent(ComponentParamImplementation.java:293)

      at com.matillion.bi.emerald.shared.component.implementation.ComponentParamImplementation.validateComponent(ComponentParamImplementation.java:261)

      at com.matillion.bi.emerald.server.controller.TransformationComponentValidator.validateTransformationComponent(TransformationComponentValidator.java:35)

      at com.matillion.bi.emerald.server.controller.ValidationService.refreshTransformationComponent(ValidationService.java:65)

      at com.matillion.bi.emerald.server.taskrunner.transformation.tasks.CreateView.runContextTask(CreateView.java:53)

      at com.matillion.bi.emerald.server.taskrunner.ContextTask.runTask(ContextTask.java:95)

      at com.matillion.bi.emerald.server.taskrunner.EmeraldTask.run(EmeraldTask.java:259)

      at com.matillion.bi.emerald.server.taskrunner.TaskThread.run(TaskThread.java:29)

      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

      at java.util.concurrent.FutureTask.run(FutureTask.java:266)

      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

      at java.lang.Thread.run(Thread.java:750)

   Caused by: com.matillion.tools.tinj.tools.validation.InvalidSqlException: No columns provided.

      at com.matillion.tools.tinj.tools.validation.ValidationResult.throwExceptionIfInvalid(ValidationResult.java:40)

      at com.matillion.tools.tinj.base.operation.AbstractOperation.getSqlStatement(AbstractOperation.java:18)

      at com.matillion.bi.emerald.component.parameters.SelectFromTableParameter.getSelectGenerator(SelectFromTableParameter.java:196)

      at com.matillion.bi.emerald.component.implementation.transformation.TableInputRS.generateSQL(TableInputRS.java:119)

      at com.matillion.bi.emerald.component.implementation.transformation.TableInputRS.generateSQL(TableInputRS.java:45)

      at com.matillion.bi.emerald.shared.component.implementation.TransformationComponentImplementation.postValidation(TransformationComponentImplementation.java:143)

2

Hi @daniel.petri​,

Were you able to resolve the issue? We seem to be experiencing a similar problem since 2am on 27th November:

Error message from our server logs:

27-Nov-2022 03:40:26.865 SEVERE [task-thread-381] com.matillion.bi.emerald.component.validation.ValidationWatcherHelper.process Failed to process validation watcher helper

java.lang.reflect.InvocationTargetException

at sun.reflect.GeneratedMethodAccessor382.invoke(Unknown Source)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:498)

at com.matillion.bi.emerald.component.validation.ValidationWatcherHelper.process(ValidationWatcherHelper.java:72)

at com.matillion.bi.emerald.shared.component.implementation.ComponentParamImplementation.validateComponent(ComponentParamImplementation.java:291)

at com.matillion.bi.emerald.shared.component.implementation.ComponentParamImplementation.validateComponent(ComponentParamImplementation.java:259)

at com.matillion.bi.emerald.server.controller.TransformationComponentValidator.validateTransformationComponent(TransformationComponentValidator.java:35)

at com.matillion.bi.emerald.server.controller.ValidationService.refreshTransformationComponent(ValidationService.java:64)

at com.matillion.bi.emerald.server.taskrunner.transformation.tasks.CreateView.runContextTask(CreateView.java:53)

at com.matillion.bi.emerald.server.taskrunner.ContextTask.runTask(ContextTask.java:96)

at com.matillion.bi.emerald.server.taskrunner.EmeraldTask.run(EmeraldTask.java:257)

at com.matillion.bi.emerald.server.taskrunner.TaskThread.run(TaskThread.java:29)

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

at java.util.concurrent.FutureTask.run(FutureTask.java:266)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

at java.lang.Thread.run(Thread.java:750)

Caused by: com.matillion.tools.tinj.tools.validation.InvalidSqlException: No columns provided.

at com.matillion.tools.tinj.tools.validation.ValidationResult.throwExceptionIfInvalid(ValidationResult.java:40)

at com.matillion.tools.tinj.base.operation.AbstractOperation.getSqlStatement(AbstractOperation.java:18)

at com.matillion.bi.emerald.component.parameters.SelectFromTableParameter.getSelectGenerator(SelectFromTableParameter.java:196)

at com.matillion.bi.emerald.component.implementation.transformation.TableInputRS.generateSQL(TableInputRS.java:122)

at com.matillion.bi.emerald.component.implementation.transformation.TableInputRS.generateSQL(TableInputRS.java:47)

at com.matillion.bi.emerald.shared.component.implementation.TransformationComponentImplementation.postValidation(TransformationComponentImplementation.java:143)

... 17 more

3

Hi folks,

 

We had the same issue, and it is due to Redshift maintenance and cluster upgrade which happened yesterday. We got AWS to revert the cluster version and we opened a Sev 1 ticket with Matillion.

 

We plan on staying on this old version for few days until Matillion figures out what the issue is.

4

Hi,

yes, same here. We did an update from version 1.0.43551 to 1.0.43980.

Surprisingly this version still doesn't exist in the official release notes!

There the last version is 1.0.43931 but we're not able to update to this version because the only version available is 1.0.43980. That's strange.

 

So we will stay on 1.0.43551 for the time being.

 

We discussed this with Matillion support and they know about this.

5

Interesting, we went one version back (from 44126 to 43931), and you went one version ahead

 

But seems like we were one version ahead of you :/

 

 

6

We have the same problem. As external tables are not necessarily production critical for us I'm wondering whether Matillion has given any suggestion as to when this can be solved?

7

Hi everyone and thank you all for taking the time to post and for your patience. The team have been investigating this and I'll go and chase them for you now. We'll update you as soon as we have any more information.

 

Thanks again,

Claire 

 

8

We just hit the same issue after Redshift upgraded to 1.0.44126

9

We were able to work around the issue by creating a view of the external table and using the view in the table input component.