ODI 11g, ODI 12c : What’s an Agent?

What is an agent?

An agent is a java process which usually located on server and listens to a port for incoming requests. It runs the requested scenario, reverse engineers requested datastores etc.

When a job submitted through ODI Studio GUI or through startscen.sh agent gets scenario from work repository and topology definitions from master repository, combines and converts them into a runnable job, usually consisting more than one code block. Then it sends code blocks to destination environments, which may be DB servers, file servers, hadoop name node etc. Finally agent gets job statuses from these environments and writes into work repository tables for us to see from Operator tab of ODI Studio.

Agent diagram from Oracle A-Team Blog

Agent Types

Standalone Agent

It is the basic agent of ODI. It does not require an application server like JEE Agent. It is easy to configure/start/stop this agent from shell. Since today I’ve always used this agent and never tried other versions. A-Team article says this is the most light weight and low footprint choice.

JEE Agent

“Java Enterprise Edition” agent, which requires an application server, in most documentation you can see the name of WebLogic Server since it’s another Oracle product. (Some search results: depending on this CertMatrix of Oracle http://www.oracle.com/technetwork/middleware/data-integration/odi-11gr1certmatrix-ps6-1928216.xls ODI 11.1.1.7.0 only supports WLS and does not support Tomcat or other application servers. You may -or may not- configure them to run together but it is not supported.) This agent is first delivered with ODI 11g. And still exists in ODI 12c.

Some pros of JEE agent which are written in A-Team blog are:

  • High availability : Through Web Logic Server’s cluster architecture, even a node is down agents may run on other nodes.
  • Configurable connection pooling : Connection pool can be configured through WLS.
  • Monitoring : Oracle Enterprise Manager can monitor, configure, alert, manage ODI JEE Agents. But I believe, there is a plug-in to be installed to achieve this tasks from OEM.

Colocated Agent

The newest agent type which has arrived with ODI 12c. This type is like a combo of other two types. Agent is a standalone agent, but can be monitored and configured through WLS. Unfortunately it does not take advantage of connection pooling, high availability. Our agent will be in WLS domain, can be managed through WLS and that’s all. It is lighter than JEE Agent. In my opinion companies which prefers JEE Agent as production agents can choose colocated agent as their DEV/TEST agent.

Agent Types diagram from Gerard Nico's website
Agent Types diagram from Gerard Nico’s website

Where to locate an agent?

To decrease network I/O it is better to locate agent to target DB server. Since agent submits code to DB Engine, it is better for them to be on same machine. Don’t forget that ODI is an E-LT tool. Which means it will load data into target server, then it will transform your data. So most of the load will be on target server. Which also means most of the codes will be submitted to target server.

Also since an agent is a local java process, agent will write files to the machine, which it is set-up on. If you have a file server seperate than DB server, then it is better to have another agent on file server to handle read/write file processes. Or to mount file servers directory to DB server as a directory and setting up only one agent is another solution.

Also these solutions will prevent any firewall related problems.

 

Thanks for reading, don’t forget to share & comment.

 

 

Resources I’ve read before writing this post:
http://www.ateam-oracle.com/odi-agents-standalone-jee-and-colocated/
http://www.ateam-oracle.com/understanding-where-to-install-the-odi-standalone-agent/
http://odibeginnertutorials.blogspot.com.tr/2013/11/2-introduction-to-odi-agents-and.html
http://www.odigurus.com/2011/10/defining-odi-agents.html
http://gerardnico.com/wiki/dit/odi/agent

[Random Thoughts] 7 Things to do Before Graduation

1- Erasmus Exchange

Erasmus is an European Union supported exchange programme. For one semester or for one academic year students go abroad to study there. EU is paying students some scholarship, which is quite enough to live. All the ask for is to success your lectures, even not all the lectures, just some percent of them is enough.

Erasmus was one of the best experiences I’ve ever had till today. I started to stand on my own feet. I learned to keep my budget. I learned to properly cook, clean, iron etc. all by myself. I learned about Italian culture, (some German culture also). I taste different foods, experienced different teaching methods, learned new languages, got new friends, saw too many cities with little money. And became a confident, self-aware guy.

In Turkey, you need a GPA and also you need to pass some exams to participate in Erasmus programme. My advice is, whatever it takes for you participate in Erasmus exchange.

Life changing experience
Life changing experience

Erasmus really changed my life, and the way I see the life. I feel more open-minded, more independent, more welcoming now. And it is too hard to stay in a place for a long time without traveling now.

2- Part-time work or long-term internship

Internships-Wordle-v3

Having a part-time job or a long-term internship will make you more experienced. especially a work in the branch that you want to become professional will be a good choice.

You will taste making money, you will become less dependent to your family.

You will start building your network. You will learn the difference between university life, university projects and the real life, real projects.

You will have some experience to write on your CV. And probably you’ll get your first job, if you are lucky and hard working enough.

3- Join student clubs & organizations

Students clubs & organizations will improve your network and soft skills. I got most of my non-IT friends thanks to student organizations. I’ve been in two different student clubs through my university life, the first one is EHAVK (Ege University Aviation Association Paragliding Team). I’ve been in this association for 5 years. I started my journey from the base to the top. From beginner pilot to instructor & tandem pilot. This association taught me about organizing events, leading a group, instructing to people, team work, presentation skills.

I am an ex-AIESECer
I am an ex-AIESECer

My second association was AIESEC. I’ve only stayed for one year in AIESEC, but it improved me alot. Because it gave me lots of responsbilities, I had the roles of Project Manager and Communication Responsible of Local Committee. I was leading a team of 3 persons. We were organising events, recruiting new members, publishing newsletter, keeping our website updated, participating in weekly meetings. It taught me a lot.

Being a member of student associations will teach you lots of things, improve your network, let you improve yourself in every manner. Try it.

4- Go to events

One of my regrets about my university life. I’ve begun attending to events in my job life. But there is never enough time to participate in the events I want.

Networking-events-blog-image

Attending to events will let you enlarge your network, stay updated about your professions matters and development. My suggestion for IT sector is to attend events like hackathons, Google Developer Group events, hackerspaces/makerspaces and vendor events.

5- Chose graduation project / thesis wisely

Another regret for me.

Your project/thesis will effect your job. It will effect your chance of getting selected for jobs and Master/PhD programmes. Choose your thesis/project on your branch, make contribution to this area.

thesis-binding-dublin-1bc

6- Have fun

remember-to-have-fun  Study hard, work harder but have fun even harder. It was our motto in AIESEC “Work hard, party harder.” It is one of the best  proverbs I’ve ever heard. Party hard, have fun hard, enjoy your university and social life while you can.

Keep in mind that these days will not come back. And there is another thing, every person I met says they were richer when      they were students. Some how it is true. I was not earning money like I am doing today. But I was living a better life. Also I had much more time for everything.

While you still have time and money, enjoy your life. Get out with friends, get crazy.

7- Move out

I also suggest you to move out if you can. Leaving without your parents  will teach you so much. You will learn to plan a budget, being tidy, cooking, cleaning, washing, ironing etc etc. You will stand on your own feet. You will face with bitter truth of bills, rent, house maintenance etc. But you’ll grow up by handling them. You’ll get mature.

543x269xmoving-out.png.pagespeed.ic_.D_d-NFibnY

That’s all from me. Thanks for reading.
Share, comment, join conversation.

 

 

 

Monthly Challenges : June ’15 Weight Loss and Standing Desk

Hello all,

I had two challenges for June and luckily I completed both of them.

1. Lose 3 kg.s in a month.

This one was easy, I will not get into details. I was 87.6 kg.s, I cut off eating junk food, I began to count my steps and put a target of 10.000 steps daily. And at the end I was 83.8 kg.s. I’ve reached and passed my target.

2. Work on Standing Desk

This was the real challenge. Actually,  when I am working at home, I am already using my DIY standing desk,  but I am working at most two hours at home. So it is not challenging.

Standing desk in the office has at least two challenges. Which are a) convincing manager and colleagues, b) really standing for 8 hours straight.

For the first part, luckily we were moving to a new office, I had the most isolated part for myself. So I will not get too much attention 🙂 And my manager is an open-minded man, he is also very friendly (once we were colleagues). Convincing manager was not that hard. It took more time for my colleagues to get used to me 🙂

Second part was hard sometimes. When you google ‘standing desk’ and read some blog posts about them. You will see some tips, which come true when I experience it. First of all just standing and working like that is not possible. I often transfer my weight from one leg to another, take some small walks in office, have some small sitting pauses when I am taking notes or a friend ask for some help.

Shoes are really important when you stand all day long. Hard soled shoes will make your day a nightmare, some people use yoga mats to soften the floor. I choose more soft soled shoes. This way my feet don’t cry for help.

I also built my standing desk in office, so it is a DIY standing desk like the one at home. This have some pros, like I have two spare shelves to put my notebooks, pens etc.

My DIY Standing Desk
My DIY Standing Desk

Now, I am happy with the result.

Have a look at also my post on LinkedIn about standing desk : https://www.linkedin.com/today/author/130746977
Leave comments, keep in touch.

New Series : Monthly Challenges

Hello all,

I am going to kick off new blog post series. By this way, I believe I will also keep the blog updated. The series are about Monthly Challenges, I’ve already completed my first challenge and its post is coming today.

I will not reveal monthly challenges until the month ends. Every challenge will start on first monday of the month and will end on last day of the month. So I may have a few days between two challenges to rest. 🙂

I got the idea from this blog post (Turkish), and he wrote that he was inspired by Matt Cutts.

Challenge posts list (will be updated every month) :

June ’15 Challenge : http://www.canburaktumer.com/blog/monthly-challenges-june-15-weight-loss-and-standing-desk/
July ’15 Challenge : http://www.canburaktumer.com/blog/monthly-challenges-july-15/