jcl - Syncsort Sum Fields=None not removing duplicates -


i'm trying run syncsort job remove duplicate entries , when run it, i'm still getting duplicates. following syncsort code i'm using:

include cond=(((61,1,ch,eq,c'p'),or,                (61,1,ch,eq,c'v')),and,               (8,2,ch,eq,c'fl'))      outrec fields=(1:12,20,                              30:36,20,                             55:61,1)               sort fields=(30,20,ch,a,                           01,20,ch,a)              sum fields=none                       

the input follows:

----+----1----+----2----+----3----+----4----+----5----+----6       fl                           amelia city               32034 fl  nassau                  fernandina beach         p 32034 fl  nassau                  amelia city              v 32034 fl  nassau                  amelia island            s 32034 fl  nassau                  fernandina               s 

i'm getting of expected output, except i'm still getting duplicates. output have follows:

----+----1----+----2----+----3----+----4----+----5----+ manatee                      bradenton                p manatee                      bradenton                p manatee                      bradenton                p manatee                      bradenton                p manatee                      bradenton                p manatee                      bradington               v polk                         bradley                  p hillsborough                 brandon                  p suwannee                     branford                 p miami-dade                   brickell                 v 

any appreciated i'm not able find error.

this sort summing on:

< ------------ sort field ----------------------->   ----+----1----+----2----+----3----+----4----+----5----+----6       fl                           amelia city               32034 fl  nassau                  fernandina beach         p 32034 fl  nassau                  amelia city              v 32034 fl  nassau                  amelia island            s 32034 fl  nassau                  fernandina               s 

the duplicate records different in first 11 bytes can not see. try removing outrec check.

possible changes -

  • change outrec inrec
  • re-code sort fields associated output, see following:

the following sort sorts based on output records:

include cond=(((61,1,ch,eq,c'p'),or,                 (61,1,ch,eq,c'v')),and,               (8,2,ch,eq,c'fl'))      outrec fields=(1:12,20,                             30:36,20,                            55:61,1)               sort fields=(42,20,ch,a,                           12,20,ch,a)              sum fields=none 

Comments