1. Stir together first 10 ingredients in a bowl. Taste and add salt as needed.
2. While whisking mixture, add olive oil in a slow stream. Add celery and next 3 ingredients; stir well. Add a few drops of hot sauce if spicier flavor is desired. Sauce should be spicy and tangy. Cover and refrigerate up to 3 weeks.