Arrange crackers on two rimmed cookie sheets.

In a small saucepan over medium heat on stovetop, combine butter and sugar. Bring to a boil and cook for 3 minutes. Stir in vanilla and chopped pecans.

Spoon pecan mixture over crackers.

Bake at 325 degrees for 6 minutes.

Remove from oven and sprinkle chocolate chips and caramel bits over crackers. Return to oven and bake about 4 minutes more or until caramel bits start to melt

Remove from oven and let cool briefly. Using a spatula, transfer crackers to a serving plate or an airtight container.