Contact US

Log In

Come Join Us!

Are you an
Engineering professional?
Join Eng-Tips Forums!
  • Talk With Other Members
  • Be Notified Of Responses
    To Your Posts
  • Keyword Search
  • One-Click Access To Your
    Favorite Forums
  • Automated Signatures
    On Your Posts
  • Best Of All, It's Free!

*Eng-Tips's functionality depends on members receiving e-mail. By joining you are opting in to receive e-mail.

Posting Guidelines

Promoting, selling, recruiting, coursework and thesis posting is forbidden.

Students Click Here

eliminate duplicate records

eliminate duplicate records

eliminate duplicate records

I enjoy sql - but sometimes can't get my head around the puzzle;  Have Table1   due to sloppy data entry have duplicates in the Table1:

OrderID  Name  Address  Email
1       Joe    xxxx     123@test.com
2       Joe S. x xxx    123@test.com
3       Fred    yyy     456@this.com
4       Jim    zzz      ttt@you.com
5       Joey S x-xxx    123@test.com
6       Jimbo    zzz    ttt@you.com

The email field is being used as the basis of determining a duplicate and there is about 25 dups per 1000 records or so...(frequently more than 2 dups often up to 4 of the same).

It is presumed the higher OrderID value is the record to be carried forward.  Thus I need to return:

OrderID  Name  Address  Email
3       Fred    yyy     456@this.com
5       Joey S x-xxx    123@test.com
6       Jimbo    zzz    ttt@you.com

have been scratching around some sql statements for awhile and would very much welcome input from someone a bit more versant than I...thanks in advance....

RE: eliminate duplicate records

Depends on which SQL you're using. You will be looking for the syntax for TOP or LIMIT in the manual, and doing a query using ORDER BY DESC on the ID field

Good Luck
To get the best from these forums read FAQ731-376 before posting

Steam Engine enthusiasts: www.essexsteam.co.uk

RE: eliminate duplicate records

You might also want to see if "SELECT DISTINCT" may be useful.

Good Luck
As a circle of light increases so does the circumference of darkness around it. - Albert Einstein

RE: eliminate duplicate records

thnks both - but am still struggling....would welcome more input....

RE: eliminate duplicate records

am thinking about this:

SELECT * FROM Table1 As X WHERE X.Email = Table1.Email AND X.OrderID > Table1.OrderID

but it will return only comparable records:
5       Joey S x-xxx    123@test.com
6       Jimbo    zzz    ttt@you.com

it leaves out:  
3       Fred    yyy     456@this.com

because the OrderID is not > than any duplicate.....

and if I use >= it will return all records of the table

RE: eliminate duplicate records

Found a relatively easy solution via 2 step;

SELECT Table1.Email, Max(Table1.[Order ID]) AS [MaxOfOrder ID]
FROM Table1
GROUP BY Table1.Email;

This gave me what I need because the nondups are by definition the max OrderID value of their group of 1...

The second step was just to join the full table with this where the OrderID were identical....

Red Flag This Post

Please let us know here why this post is inappropriate. Reasons such as off-topic, duplicates, flames, illegal, vulgar, or students posting their homework.

Red Flag Submitted

Thank you for helping keep Eng-Tips Forums free from inappropriate posts.
The Eng-Tips staff will check this out and take appropriate action.

Reply To This Thread

Posting in the Eng-Tips forums is a member-only feature.

Click Here to join Eng-Tips and talk with other members! Already a Member? Login


Low-Volume Rapid Injection Molding With 3D Printed Molds
Learn methods and guidelines for using stereolithography (SLA) 3D printed molds in the injection molding process to lower costs and lead time. Discover how this hybrid manufacturing process enables on-demand mold fabrication to quickly produce small batches of thermoplastic parts. Download Now
Design for Additive Manufacturing (DfAM)
Examine how the principles of DfAM upend many of the long-standing rules around manufacturability - allowing engineers and designers to place a part’s function at the center of their design considerations. Download Now
Taking Control of Engineering Documents
This ebook covers tips for creating and managing workflows, security best practices and protection of intellectual property, Cloud vs. on-premise software solutions, CAD file management, compliance, and more. Download Now

Close Box

Join Eng-Tips® Today!

Join your peers on the Internet's largest technical engineering professional community.
It's easy to join and it's free.

Here's Why Members Love Eng-Tips Forums:

Register now while it's still free!

Already a member? Close this window and log in.

Join Us             Close