I'm very new to pipeline pilot. So,the questions I ask are might be simple to most users in this community. But, I just could't figure it out. I've been trying to figure out how to filter out duplicate value for a column(ex. subject id). So, if there is a duplicate subject id, i would like the whole row (with many columns) to be output into a different table. One table will have all distinct subject id. The other table will contains all the duplicates. If 001 appears 3 times, then the first 001 row will go to the distinct table, the other two 001 will go to the duplicate table.

or

All three 001 s can go to the duplicate table.
Is there a way to do one or other option?

Also, how to detect missing value? row 1 has subject id column missing but other columns have value. How to output the row with missing subject id?

Last question. I have a time value 9:00 in the collection time column. When the file got read in using excel reader, the time 9:00 becomes a date, ex Dec. 21, 1983. How can I read time value properly?

Will appreciate any the input!