Data mining application

how to start

  • (2 Pages)
  • +
  • 1
  • 2

20 Replies - 2074 Views - Last Post: 21 March 2010 - 02:56 PM

#1 alowais  Icon User is offline

  • D.I.C Head

Reputation: 0
  • View blog
  • Posts: 55
  • Joined: 13-September 08

Data mining application

Posted 13 September 2009 - 08:15 PM

Hi everyone ,

I'm about to implement an application using data mining technique but i really don't know how to start designing it.

I want suggestion and ideas from you.

The application is to predict the good credit risk from bad credit risk customers, when a customer wants to obtain a credit card or a loan from the bank ,they will ask for information which normally will be the income ,age ,citizenship ..etc..

So the bank based on the information provided will decide on weather this applicant has a high risk or low risk weather he will pay the loan or the credit card payments or not.


Thanksssz,

Is This A Good Question/Topic? 0
  • +

Replies To: Data mining application

#2 modi123_1  Icon User is online

  • Suitor #2
  • member icon



Reputation: 8374
  • View blog
  • Posts: 31,122
  • Joined: 12-June 08

Re: Data mining application

Posted 14 September 2009 - 08:57 AM

Ah.. yeah.. if you are asking the question it might be out of your league. I mean that is an insane amount of data to make this functional for a classroom let alone running a business off it.

http://www.theiia.or...and-techniques/

This post has been edited by modi123_1: 14 September 2009 - 08:59 AM

Was This Post Helpful? 0
  • +
  • -

#3 KYA  Icon User is offline

  • g++ jameson.cpp -o beverage
  • member icon

Reputation: 3089
  • View blog
  • Posts: 19,137
  • Joined: 14-September 07

Re: Data mining application

Posted 14 September 2009 - 08:59 AM

Hmmmm, if the credit score (FICO) is already calculated, do a query on anything > #theBankIsWillingToTolerate

[camel case ftw]

If you need to actually compute a credit score to determine risk, then the scope of the project just got a lot bigger. A lot.
Was This Post Helpful? 0
  • +
  • -

#4 MajorWalrus  Icon User is offline

  • D.I.C Head

Reputation: 10
  • View blog
  • Posts: 115
  • Joined: 22-April 09

Re: Data mining application

Posted 14 September 2009 - 11:13 AM

Yeah. Seems like you not doing mining so much. Cause the customer is going to provide all the required information. Right?

So its basically an algorithm that computes risk based on some formula. The bank would have to determine criteria and weights for the various variables.

Also, weather = rain, clouds, ect. You mean "whether." :)

Good luck!
Was This Post Helpful? 0
  • +
  • -

#5 alowais  Icon User is offline

  • D.I.C Head

Reputation: 0
  • View blog
  • Posts: 55
  • Joined: 13-September 08

Re: Data mining application

Posted 15 September 2009 - 12:04 AM

loolzz..
Ok Mr.weather ,you're right the data will be provided but how should I determine criteria and weights for the various variables ?
I mean based on What the decision will be taken to accept or reject the customer?
Was This Post Helpful? 0
  • +
  • -

#6 modi123_1  Icon User is online

  • Suitor #2
  • member icon



Reputation: 8374
  • View blog
  • Posts: 31,122
  • Joined: 12-June 08

Re: Data mining application

Posted 15 September 2009 - 07:48 AM

View Postalowais, on 15 Sep, 2009 - 01:04 AM, said:

loolzz..
Ok Mr.weather ,you're right the data will be provided but how should I determine criteria and weights for the various variables ?
I mean based on What the decision will be taken to accept or reject the customer?


Mr. Weather? Huh?

The criteria and weight are determined by you, your bosses, or who ever has a stake in the output. Based on the output work backwards.
Was This Post Helpful? 0
  • +
  • -

#7 KYA  Icon User is offline

  • g++ jameson.cpp -o beverage
  • member icon

Reputation: 3089
  • View blog
  • Posts: 19,137
  • Joined: 14-September 07

Re: Data mining application

Posted 15 September 2009 - 08:37 PM

I would say the bank. They have the final authority on who gets a loan. Ask them for the criteria they would normally review "by hand" and then devise an algorithm based on the information. You've then automated the process (which is their goal).

This post has been edited by KYA: 15 September 2009 - 08:37 PM

Was This Post Helpful? 0
  • +
  • -

#8 no2pencil  Icon User is offline

  • Head MFIC
  • member icon

Reputation: 5066
  • View blog
  • Posts: 26,448
  • Joined: 10-May 07

Re: Data mining application

Posted 15 September 2009 - 08:39 PM

Where are you planning on mining this data & what are you planning to find?
Was This Post Helpful? 1
  • +
  • -

#9 alowais  Icon User is offline

  • D.I.C Head

Reputation: 0
  • View blog
  • Posts: 55
  • Joined: 13-September 08

Re: Data mining application

Posted 16 September 2009 - 06:43 AM

View PostKYA, on 15 Sep, 2009 - 07:37 PM, said:

I would say the bank. They have the final authority on who gets a loan. Ask them for the criteria they would normally review "by hand" and then devise an algorithm based on the information. You've then automated the process (which is their goal).


OK let us say they asked the customer about the age , education ,citizenship ,material status ,income and gender , they will consider the higher age and income case better than the lower ones and the citizenship is also an imporatant factor.

So the question here ist just that simple? understand the relation between those attributes and then finsh? (No way!!)


View Postno2pencil, on 15 Sep, 2009 - 07:39 PM, said:

Where are you planning on mining this data & what are you planning to find?


What am planning to find ? Is the decision to finance the customer or provide him with a credit card.

But "Where are you planning on mining this data" I don't understand what you meant by where.

Thanks,
Was This Post Helpful? 0
  • +
  • -

#10 modi123_1  Icon User is online

  • Suitor #2
  • member icon



Reputation: 8374
  • View blog
  • Posts: 31,122
  • Joined: 12-June 08

Re: Data mining application

Posted 16 September 2009 - 09:33 AM

View Postalowais, on 16 Sep, 2009 - 07:43 AM, said:

View PostKYA, on 15 Sep, 2009 - 07:37 PM, said:

I would say the bank. They have the final authority on who gets a loan. Ask them for the criteria they would normally review "by hand" and then devise an algorithm based on the information. You've then automated the process (which is their goal).


OK let us say they asked the customer about the age , education ,citizenship ,material status ,income and gender , they will consider the higher age and income case better than the lower ones and the citizenship is also an imporatant factor.

So the question here ist just that simple? understand the relation between those attributes and then finsh? (No way!!)


View Postno2pencil, on 15 Sep, 2009 - 07:39 PM, said:

Where are you planning on mining this data & what are you planning to find?


What am planning to find ? Is the decision to finance the customer or provide him with a credit card.

But "Where are you planning on mining this data" I don't understand what you meant by where.

Thanks,


Where as in what industry? Is this for fun? For a job? For school?

Again it's not your job to come up with the relations of data - but your job to implement it.
Was This Post Helpful? 0
  • +
  • -

#11 alowais  Icon User is offline

  • D.I.C Head

Reputation: 0
  • View blog
  • Posts: 55
  • Joined: 13-September 08

Re: Data mining application

Posted 16 September 2009 - 10:15 AM

It's a project I've been asked to do.
Was This Post Helpful? 0
  • +
  • -

#12 Aeternalis  Icon User is offline

  • D.I.C Regular

Reputation: 28
  • View blog
  • Posts: 291
  • Joined: 13-July 09

Re: Data mining application

Posted 16 September 2009 - 01:39 PM

Credit card companies pay big bucks to data mining specialists to recover this type of information from their databases. The information they use to determine a persons credit worthiness is also recalculated often to determine if they should lower/ raise their limit or close the account, or other decisions that are made to mitigate their risk exposure.

The actual formulas they use to calculate the risk for each person is based on statistical data that is mined from their databases and is considered proprietary information. They keep it secret for good reason as their competitors could use that information to increase their own market position. by undercutting them, or outselling them. Generally the credit score is not determined by aggregating these factors, but instead the credit score is one factor of many that help them determine your risk.

Since your work is just for a school project, you wont have to concern yourself with actual implementation scenarios. Just create your own proprietary formulas that are logical and are based off of the data you are provided. As long as your getting your information from the data provided and using that information to make decisions about what risks to take on which customers, you should be in the clear. After all data mining is just about turning data into useable information.

Aet
Was This Post Helpful? 0
  • +
  • -

#13 Jayman  Icon User is offline

  • Student of Life
  • member icon

Reputation: 418
  • View blog
  • Posts: 9,532
  • Joined: 26-December 05

Re: Data mining application

Posted 16 September 2009 - 02:07 PM

You should be asking these questions from whomever assigned you the project. They are the ones who will define the criteria that will determine the amount of risk.

There is not a specific formula to calculate risk, the formula is specific to the clients needs.
Was This Post Helpful? 0
  • +
  • -

#14 NickDMax  Icon User is offline

  • Can grep dead trees!
  • member icon

Reputation: 2247
  • View blog
  • Posts: 9,237
  • Joined: 18-February 07

Re: Data mining application

Posted 16 September 2009 - 02:57 PM

The original post does not really seem to describe data mining to me. Data mining is about finding knowledge. It looks for patterns and correlations that are not readily apparent from the data.

Data mining would not be much help in determining if user A is a good risk or a bad risk -- it would be helpful in formulating rules for telling if people who meet certain criteria are a good risk or a bad risk.

Data mining is done with large data-sets and generally takes a good amount of time to run and even longer to analyze the data to sort out noise from quality knowledge. So you don't re-mine every time a user requests a credit card! That would not be cost effective and really would not generate any new information (on the small scale, it should generally take quite a few new data points to represent a new pattern).

So what you are asking about is not data-mining but what people do with the knowledge gained. i.e -- Using data mining to form statistical profiles used for risk assessments.

The problem with your idea is getting the data to initially mine. You would need 1000's of credit histories along with the correlating personal meta-data. While large credit institutions would have such data -- there are very strict rules upon how they must treat that data and what they are allowed to use it for.
Was This Post Helpful? 0
  • +
  • -

#15 alowais  Icon User is offline

  • D.I.C Head

Reputation: 0
  • View blog
  • Posts: 55
  • Joined: 13-September 08

Re: Data mining application

Posted 18 September 2009 - 06:51 AM

View PostAeternalis, on 16 Sep, 2009 - 12:39 PM, said:

Since your work is just for a school project, you wont have to concern yourself with actual implementation scenarios.
Just create your own proprietary formulas that are logical and are based off of the data you are provided


"My own proprietary formulas that are logical " , And how can I know if it's correct formulas or not?

Thanks alot to you.
Was This Post Helpful? 0
  • +
  • -

  • (2 Pages)
  • +
  • 1
  • 2