Arrange crackers on two rimmed cookie sheets.
In a small saucepan over medium heat on stovetop, combine butter and sugar. Bring to a boil and cook for 3 minutes. Stir in vanilla and chopped pecans.
Spoon pecan mixture over crackers.
Bake at 325 degrees for 6 minutes.
Remove from oven and sprinkle chocolate chips and caramel bits over crackers. Return to oven and bake about 4 minutes more or until caramel bits start to melt
Remove from oven and let cool briefly. Using a spatula, transfer crackers to a serving plate or an airtight container.