Monthly Archives: March 2017
Issue: While I was loading Data from an RDBMS Database to Spark, I happened to see the error below, val details=spark.load(“jdbc”,Map(“url” -> “jdbc:oracle:thin:scott/tiger@//oracle:1521:sample”, “dbtable” -> “scott.employees”)) <console>:23: error: value load is not a member of org.apache.spark.sql.SparkSession val details=spark.load(“jdbc”,Map(“url” -> “jdbc:oracle:thin:scott/tiger@//oracle:1521:sample”, … Continue reading
Issue: [hadoop@node1 ~]$ scala -version Exception in thread “main” java.lang.UnsupportedClassVersionError: scala/tools/nsc/MainGenericRunner : Unsupported major.minor version 52.0 at java.lang.ClassLoader.findBootstrapClass(Native Method) at java.lang.ClassLoader.findBootstrapClassOrNull(ClassLoader.java:1070) Cause: Unsupported Version of Scala and Java Resolution: For Scala version scala-2.12.1, use Java 1.8 +. For Scala … Continue reading
Applying patches to RAC environments (on Linux) in a rolling manner, with zero downtime to applications.
The scope of this post is to apply patches to RAC environments (on Linux) in a rolling manner, with zero downtime to applications. Pre-requisites RAC environment (2 or more nodes) Application should be RAC aware Refer the Note id (756671.1) … Continue reading
Exception in thread “main” java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected
Issue: While configuring Sqoop (Sqoop: Downloaded was 1.4.6) on HDFS (Hadoop: 2.7.2), I encountered the below error, Exception in thread “main” java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected at org.apache.sqoop.config.ConfigurationHelper.getJobNumMaps(ConfigurationHelper.java:65) at com.cloudera.sqoop.config.ConfigurationHelper.getJobNumMaps(ConfigurationHelper.java:36) at org.apache.sqoop.mapreduce.db.DataDrivenDBInputFormat.getSplits(DataDrivenDBInputFormat.java:125) Cause: Could be something to do … Continue reading
Spark has multiple APIs (Spark Scala, Spark Java, Spark Python, Spark R) on which it can be setup. Lets see Spark setup on Scala API. Download the SPARK from the link http://spark.apache.org/downloads.html Un-compress the downloaded file [hadoop@node1 hadoop]$ tar -xvf … Continue reading
Incorrect configuration: namenode address dfs.namenode.servicerpc-address or dfs.namenode.rpc-address is not configured.
Issue: While configuring Apache Hadoop 2.7.2, I encountered the error stated. Incorrect configuration: namenode address dfs.namenode.servicerpc-address or dfs.namenode.rpc-address is not configured. Cause: Could be something to do with core-site.xml Resolution: There was a space after “fs.default.name” and before </name> … Continue reading
This Blog post helps you to get an idea on upgrading Informatica from 9.0.1 to 9.6.1. Analysis: Informatica Upgrade from 9.0.1 to 9.6.1 is directly not supported. You need to follow the below path for the upgrade Upgrade Informatica 9.0.1 … Continue reading
Issue: Informatica Admin Console url which is a Secured site (https://hostname:8443), suddenly stopped working with the message in Browser “CYPHER MISMATCH (DSA keys)” Resolution: Shutdown Powercenter services. Delete the folders and files under following folders: <INFA_HOME>\tomcat\temp <INFA_HOME>\tomcat\work Delete only the … Continue reading
Overview: Apache Sqoop is a command line tool to load Data from RDBMS Databases to Hadoop and vice-versa. The Name Sqoop originated from Hadoop and SQL by taking SQ (from SQL) and OOP (from HadOOP). Sqoop uses Map Reduce to … Continue reading
There are some beautiful note ids in Oracle, which talks about the purging strategy of Sysaux. I’ve put together few note ids which will be of help for quick reference. Below are the details, Suggestions if Your SYSAUX Tablespace Grows … Continue reading