Monthly Archives: March 2017

:23: error: value load is not a member of org.apache.spark.sql.SparkSession

Issue: While I was loading Data from an RDBMS Database to Spark, I happened to see the error below, val details=spark.load(“jdbc”,Map(“url” -> “jdbc:oracle:thin:scott/tiger@//oracle:1521:sample”, “dbtable” -> “scott.employees”)) <console>:23: error: value load is not a member of org.apache.spark.sql.SparkSession val details=spark.load(“jdbc”,Map(“url” -> “jdbc:oracle:thin:scott/tiger@//oracle:1521:sample”, … Continue reading

Posted in Spark | Leave a comment

Exception in thread “main” java.lang.UnsupportedClassVersionError:scala/tools/nsc/MainGenericRunner

Issue: [hadoop@node1 ~]$ scala -version Exception in thread “main” java.lang.UnsupportedClassVersionError: scala/tools/nsc/MainGenericRunner : Unsupported major.minor version 52.0 at java.lang.ClassLoader.findBootstrapClass(Native Method) at java.lang.ClassLoader.findBootstrapClassOrNull(ClassLoader.java:1070)   Cause:  Unsupported Version of Scala and Java   Resolution: For Scala version scala-2.12.1, use Java 1.8 +. For Scala … Continue reading

Posted in Scala, Spark | Leave a comment

Applying patches to RAC environments (on Linux) in a rolling manner, with zero downtime to applications.

The scope of this post is to apply patches to RAC environments (on Linux) in a rolling manner, with zero downtime to applications. Pre-requisites RAC environment (2 or more nodes) Application should be RAC aware Refer the Note id (756671.1) … Continue reading

Posted in Oracle Database, Oracle RAC | Leave a comment

Exception in thread “main” java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected

Issue: While configuring Sqoop (Sqoop: Downloaded was 1.4.6) on HDFS (Hadoop: 2.7.2), I encountered the below error, Exception in thread “main” java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected        at org.apache.sqoop.config.ConfigurationHelper.getJobNumMaps(ConfigurationHelper.java:65)        at com.cloudera.sqoop.config.ConfigurationHelper.getJobNumMaps(ConfigurationHelper.java:36)        at org.apache.sqoop.mapreduce.db.DataDrivenDBInputFormat.getSplits(DataDrivenDBInputFormat.java:125) Cause: Could be something to do … Continue reading

Posted in Hadoop, Sqoop | Leave a comment

Spark Setup on RHEL 7.2 and Apache Hadoop 2.7

Spark has multiple APIs (Spark Scala, Spark Java, Spark Python, Spark R) on which it can be setup. Lets see Spark setup on Scala API. Download the SPARK from the link http://spark.apache.org/downloads.html Un-compress the downloaded file [hadoop@node1 hadoop]$ tar -xvf … Continue reading

Posted in Spark | Leave a comment

Incorrect configuration: namenode address dfs.namenode.servicerpc-address or dfs.namenode.rpc-address is not configured.

Issue: While configuring Apache Hadoop 2.7.2, I encountered the error stated. Incorrect configuration: namenode address dfs.namenode.servicerpc-address or dfs.namenode.rpc-address is not configured.   Cause: Could be something to do with core-site.xml   Resolution: There was a space after “fs.default.name” and before </name> … Continue reading

Posted in Hadoop | 1 Comment

Informatica Power Center Upgrade from 9.0.1 to 9.6.1

This Blog post helps you to get an idea on upgrading Informatica from 9.0.1 to 9.6.1. Analysis: Informatica Upgrade from 9.0.1 to 9.6.1 is directly not supported. You need to follow the below path for the upgrade Upgrade Informatica 9.0.1 … Continue reading

Posted in Informatica | Leave a comment

Informatica url issue – CYPHER MISMATCH (DSA keys)

Issue: Informatica Admin Console url which is a Secured site (https://hostname:8443), suddenly stopped working with  the message in Browser “CYPHER MISMATCH (DSA keys)” Resolution: Shutdown Powercenter services. Delete the folders and files under following folders: <INFA_HOME>\tomcat\temp <INFA_HOME>\tomcat\work Delete only the … Continue reading

Posted in Informatica | Leave a comment

Sqoop – Load Data to HDFS from Oracle

Overview: Apache Sqoop is a command line tool to load Data from RDBMS Databases to Hadoop and vice-versa. The Name Sqoop originated from Hadoop and SQL by taking SQ (from SQL) and OOP (from HadOOP). Sqoop uses Map Reduce to … Continue reading

Posted in Sqoop | Leave a comment

Sysaux Tablespace growing Huge – SM/OPTSTAT, SM/AWR

There are some beautiful note ids in Oracle, which talks about the purging strategy of Sysaux. I’ve put together few note ids which will be of help for quick reference. Below are the details, Suggestions if Your SYSAUX Tablespace Grows … Continue reading

Posted in Oracle Database | Leave a comment