Despite the abundance of the available variables, ground truth is privy to knowledge about the problem seldom revealed in practice. By discovering important features, researchers can further conduct a more targeted follow-up experiment on the selected features tailored for understanding the scientific phenomenon. A natural requirement is that we wish to discover as many relevant variables as possible and make as few mistakes as possible at the same time. We propose a modified RuleFit with FDR control by knockoff procedure and with alpha control by Neyman-Pearson method.