Pakistani opener Khurram Manzoor was caught behind just before the interval from the bowling off Rangana Herath. Manzoor made 23 runs from 35 balls.
Earlier, Sri Lanka started the day two of the Colombo Test at 261/8 and were all out at 320 runs.
Pakistani pacer Junaid Khan grabbed five wickets whereas fast bowler Wahab Riaz took three wickets. Spinners Saeed Ajmal and Abdul Rehman took one wicket each.