Contact US

Log In

Come Join Us!

Are you an
Engineering professional?
Join Eng-Tips Forums!
  • Talk With Other Members
  • Be Notified Of Responses
    To Your Posts
  • Keyword Search
  • One-Click Access To Your
    Favorite Forums
  • Automated Signatures
    On Your Posts
  • Best Of All, It's Free!

*Eng-Tips's functionality depends on members receiving e-mail. By joining you are opting in to receive e-mail.

Posting Guidelines

Promoting, selling, recruiting, coursework and thesis posting is forbidden.

Students Click Here

Data selection and modelling.

Data selection and modelling.

Data selection and modelling.


I have a large quantity of data from a test site where 500 parameters are measured every minute and I have acces to 2 years of this data. I want to model 5 of these parameters in function of the most important other parameters (The model has 5 Output parameters and I want to select the best parameters to model these 5 output parameters). The data set is noisy, clouded and some parameters are redundant. I am looking for a method to determine the parameters which are higly correlated with the 5 parameters I have to model. I know I can just calculate the correlation coeficcients. But I dont think this is suffucient.

I have examined a method called Principal Component Analysis but I dont think there is a way to Calculate Principal Components in function of the 5 parameters I wish to model. Here comes my first question, is there a method wich calculates Principal Components in function of other parameters?

I am currently examining feature selection but I don't find good references about this method. Can someone give advice on this method?

If you have any other method to calculate the best variables to model with in function of the output parameters.

Thanks in advance, Regards

RE: Data selection and modelling.

Try a designed experiment to determine which parameters and interactions directly affect performance.  From there, you should be able to simplify your data mining.


RE: Data selection and modelling.

Thank you for your reply.

But I am not allowed to perform experiments on the site. I have to do it with the data I can acces. I also don't think that the site allows such controlled experiments since it is constantly in industrial application.
kind regards,

RE: Data selection and modelling.

It doesn't mean you have to experiment on site.  You select a portion of data where one variable is holding constant, then a second set where a different variable is constant.  You can then perform data regressions to see how the variables interact and if an equation.

The problem is trying to pare it down.  The best way is to plot several variables and visually see which ones appear to matches first.  Somethings can be deduced from principles, like reactions speed up with temperatur in a power function.  Heat transfer is proportional to delta t.

Generally its called "design of experiments" under advanced Statistical Process Controls tools, google that to find articles.

RE: Data selection and modelling.

Thank you for clarifying my posting intent dcasto.


RE: Data selection and modelling.

Thank you for your answers. I'll look things up and let you know if it worked!
Thank you very much! Regards

RE: Data selection and modelling.

FACTOR analysis with two factors can determine best variables compatible with your 5 vars. Draw a 2-D graph of the two factors to visually confirm close association of variables.

Red Flag This Post

Please let us know here why this post is inappropriate. Reasons such as off-topic, duplicates, flames, illegal, vulgar, or students posting their homework.

Red Flag Submitted

Thank you for helping keep Eng-Tips Forums free from inappropriate posts.
The Eng-Tips staff will check this out and take appropriate action.

Reply To This Thread

Posting in the Eng-Tips forums is a member-only feature.

Click Here to join Eng-Tips and talk with other members! Already a Member? Login


Close Box

Join Eng-Tips® Today!

Join your peers on the Internet's largest technical engineering professional community.
It's easy to join and it's free.

Here's Why Members Love Eng-Tips Forums:

Register now while it's still free!

Already a member? Close this window and log in.

Join Us             Close