The two premiers are in Paris along with 145 other heads and representatives of different countries to attend the UN moot.
According to details, the Indian PM walked up to PM Sharif to shake hands with him and later both the figures sat on a sofa together.
They had a brief discussion at the meeting held in a friendly atmosphere. The overall regional situation along with bilateral ties was discussed.
The meeting between the leaders of the two nuclear-armed South Asian countries took place for the first time after tensions increased between the two countries over several issues.
Prime Minister Nawaz Sharif and Afghan President Ashraf Ghani also met in Paris as well.