According to the wiki:

Tozzetti later wrote that Capponi's explanation for taking the two fingers as relics was "because Galileo wrote so many beautiful things with them."

Galileo’s middle finger