Read authentic reviews from customers, clients and employees.
Find top rated recruiters on the GR Marketplace
 

Benchmark IT - Technology Talent

4.78 from 1268 reviews
 

Jobs

Vice President, AI Engineer - Full Time - Hybrid

New York, United States
DIRECT HIRE
  • TERMS: direct hire
Vice President, AI Engineer -  Full Time - Hybrid About the Role Our client, a leading NYC fintech firm, is hiring a VP Artificial Intelligence Engineer to lead the design, development and delivery of production-grade AI systems that drive measurable business outcomes across the firm. This individual will own key workstreams and serve as a technical leader, driving system design, mentoring engineers, partnering directly with business stakeholders and ensuring that AI capabilities are built to production-grade standards of reliability, scalability, and measurability. Responsibilities
  • Lead the architecture and delivery of production AI systems, including document intelligence (IDP), intelligent knowledge systems, agentic orchestration, conversational AI and generative AI applications.
  • Own AI projects end-to-end, from problem scoping and stakeholder alignment through solution design, implementation, deployment, monitoring and continuous improvement.
  • Drive technical design and architectural decisions for the team, including API design, system decomposition, evaluation strategy and infrastructure patterns, establishing standards that raise the quality bar across the AI/ML platform.
  • Architect and champion robust evaluation frameworks for AI systems, defining statistically sound, problem-specific metrics, curating benchmark datasets and enforcing strict versioning to ensure reproducibility and continuous improvement.
  • Partner directly with cross-functional stakeholders, including the Product, Operations, Legal, and Business teams, to identify AI opportunities, translate requirements into technical plans, and communicate tradeoffs, risks, and recommendations clearly.
  • Mentor and develop engineers on the team through code review, design review, pair problem-solving, and knowledge sharing, acting as a technical role model and raising the overall capability of the group. 
Qualifications
  • 7+ years of experience developing and deploying production AI/ML systems, including cloud-native solutions on AWS or similar platforms, with a proven track record of delivering complex applications from design through production.
  • Strong proficiency in Python and software engineering best practices, including source control, CI/CD, testing, documentation, and the development of scalable, maintainable software
  • Deep expertise building production AI solutions, including LLM applications, AI agents, retrieval-augmented generation (RAG), conversational AI, document intelligence, and agentic workflows, with hands-on experience using modern AI frameworks, tooling, and protocols such as MCP and A2A.
  • Experience designing, deploying and operating end-to-end machine learning pipelines, including model training, deployment, monitoring, evaluation, and continuous improvement in production environments.
  • Strong foundation in statistics, experimentation, data quality, and AI system evaluation, with experience developing benchmarks, defining performance metrics, analyzing errors, and optimizing systems for accuracy, reliability, scalability, cost, and latency
  • Experience leading technical design and architectural decisions, conducting code and design reviews, mentoring engineers and driving engineering excellence across teams
  • Excellent written and verbal communication skills, with the ability to document technical solutions, collaborate with cross-functional stakeholders, and communicate complex concepts to both technical and non-technical audiences
  • Experience in financial services or FinTech, particularly within document-heavy, regulated, or compliance-sensitive environments is highly preferred.
Benefits
  • The base salary range for this role is $170,000 to $210,000 plus bonus and equity. 
  • Hybrid schedule: in office Monday–Thursday with the flexibility to work remotely on Friday.
By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Benchmark IT, LLC and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here:https://bmarkits.com/privacy-policy/

Client Delivery Specialist - Associate / AVP - Full Time - Hybrid

Stamford, Connecticut, United States
DIRECT HIRE
  • TERMS: direct hire
Client Delivery Specialist - Associate / AVP - Full Time - Hybrid About the Role We’re partnering with our client, a fast-growing fintech firm, on a Client Delivery Specialist to join its Data Solutions Team. This is an individual contributor for either an Associate or AVP level. This role sets up and maintains the financial software applications the firm utilizes, assists clients with issues, works on special projects, and helps with ad-hoc tasks tied to building an innovative company. This position is a mix of finance and technology, ideal for someone who wants to grow their career at the intersection of both. Responsibilities
  • Support financial reporting and data aggregation tools, including analyzing and explaining portfolio performance results
  • Conduct account-level reconciliation, including research and resolution of breaks, cancels, and corrections
  • Perform analysis of private equity and hedge fund statements for input into the system
  • Work with clients and partners to resolve data issues
  • Help manage client onboarding, account setup and training, and day-to-day support and issue management
  • Perform system setup and configuration, new client setup, and new financial account/asset classification
  • Assist with data feed management
  • Create custom reports based on client-specific needs and liaise with vendor partners on enhancements and system/data issues
Qualifications
  • 3–5 years of experience in a related field
  • Bachelor's degree from an undergraduate program
  • Excellent customer service skills and the ability to foster and maintain effective relationships
  • Strong understanding of financial instruments
  • Experience with RIA/wealth management policies, procedures, and client service
  • Experience working with wirehouses or custodians
  • Organized and self-motivated, with the ability to prioritize tasks and meet deadlines
  • Experience with Addepar, Black Diamond or similar wealth management platforms
  • Strong MS Excel and PowerPoint skills; basic knowledge of database concepts and programming
  • Understanding of performance reporting calculations and methodologies, portfolio management and rebalancing, and how family offices, RIAs, and investment advisors operate
  • Strong critical thinking and problem-solving skills, with the ability to summarize information clearly and concisely, written and verbal
  • Quick learner, able to adapt to an expanding environment
Compensation & Benefits This role offers a competitive compensation package including base salary, equity for all full-time employees, and an annual performance bonus. Benefits include an employer-matched retirement plan, generously subsidized healthcare with 100% employer-paid dental, vision, telemedicine, and virtual mental health counseling, parental leave, and unlimited paid time off (PTO). Employees in this role work in the office Monday–Thursday, with the flexibility to work remotely on Friday. By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Benchmark IT, LLC and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here: https://bmarkits.com/privacy-policy/

Lead Azure Application Support Engineer - Long-term Hybrid Contract

Montvale, New Jersey, United States
CONTRACT
  • TERMS: contract
Lead Azure Application Support Engineer

Long-term contract position | Global, cutting-edge Azure applications

We are seeking senior application engineers to support sophisticated Azure-based applications used by a global organization. Long-term (24 mo +) contracts, Hybrid 3 days/week onsite (Tue, Wed, Thurs).

These are hands-on technical roles—not help-desk or traditional support-management positions. You will solve difficult production problems, guide a distributed onshore/offshore support team, and work closely with application development and program leadership to improve reliability and performance.

What You’ll Do
  • Lead the investigation and resolution of complex Azure application issues.

  • Troubleshoot problems across the user interface, application services, integrations, databases, and Azure PaaS environment.

  • Use Application Insights, Azure Monitor, and KQL to diagnose performance issues, errors, and unexpected application behavior.

  • Coordinate major incident response, identify root causes, and ensure permanent corrective actions are completed.

  • Provide technical direction to onshore and offshore support resources.

  • Work closely with developers on application changes, releases, fixes, and production readiness.

  • Improve support processes, monitoring, technical documentation, and team effectiveness.

What We’re Looking For
  • Strong hands-on experience supporting Azure-based enterprise applications in production.

  • Ability to troubleshoot across multiple application layers—not simply route or manage tickets.

  • Experience with Azure PaaS services, Application Insights, Azure Monitor, and KQL.

  • Working knowledge of application performance, APIs, integrations, networking, and cloud infrastructure.

  • Familiarity with Cosmos DB or PostgreSQL is helpful.

  • Experience leading distributed technical teams and holding internal and external resources accountable.

  • Calm, methodical problem-solving skills during critical incidents.

  • Strong communication, ownership, and empathy for application users.

  • Experience supporting applications within a large, global organization is strongly preferred.

Any experience supporting applications that use Azure OpenAI, generative AI, or related AI services is helpful.

Azure certifications, ITIL experience, and a computer science degree are helpful but not required.

Why Consider This Role?

You’ll support modern, highly visible applications within a global enterprise, work with advanced Azure and AI technology, and have the authority to improve how critical applications are supported. These are stable, long-term assignments offering both challenging hands-on work and meaningful technical leadership.

Work authorization: Candidates must be authorized to work in the United States without current or future sponsorship.

 

By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Benchmark IT, LLC and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here: https://bmarkits.com/privacy-policy/  

IT Director - Enterprise Systems

White Plains, New York, United States
DIRECT HIRE
  • TERMS: direct hire
Overview

Our direct client seeking a hands-on Director of Enterprise Systems to lead and evolve their technology environment while helping drive the next phase of growth through automation, AI, and business-focused technology initiatives.

This role serves as a strategic partner to leadership, aligning systems, vendors, and technology investments with business priorities. The ideal candidate combines strong technical and infrastructure expertise with the ability to identify opportunities where technology, automation, and AI can improve efficiency, decision-making, and execution across the organization.

This is a highly visible role within a lean team environment. Success requires both strategic thinking and a willingness to roll up your sleeves to help solve complex technology challenges when needed.

Responsibilities Technology Strategy & Business Enablement
  • Own and execute the organization's technology strategy, aligning initiatives with business goals and long-term growth objectives
  • Partner closely with leadership to identify opportunities to improve operational efficiency, decision-making, and execution through technology
  • Evaluate emerging technologies, automation opportunities, and AI solutions that can create measurable business value
  • Develop and drive an AI adoption roadmap, identifying practical use cases and ensuring successful implementation across the organization
  • Communicate technology initiatives, priorities, and ROI to executive leadership
Systems, Automation & Innovation
  • Own the lifecycle of core business systems, including evaluation, implementation, integration, enhancement, and optimization
  • Lead automation initiatives that reduce manual processes and improve operational performance
  • Ensure systems architecture supports scalable growth and future AI capabilities
  • Continuously assess and improve technology platforms to support evolving business needs
IT Operations & Infrastructure
  • Provide oversight of infrastructure, cloud platforms, networks, and enterprise systems to ensure reliability, performance, and scalability
  • Lead resolution of complex technology issues and critical business-impacting incidents
  • Partner with technical staff and vendors to maintain secure and efficient operations
  • Maintain disaster recovery and business continuity capabilities
Cybersecurity & Risk Management
  • Develop and maintain cybersecurity policies, controls, and risk management practices
  • Support compliance initiatives, audits, and security assessments
  • Ensure technology environments follow industry best practices for security and governance
Vendor Management & Governance
  • Manage relationships with technology vendors, service providers, and external partners
  • Evaluate vendor performance, negotiate contracts, and ensure alignment with business objectives
  • Manage technology budgets with a focus on ROI and business impact
  • Establish technology standards, documentation, and governance processes
Qualifications
  • 5-10 years of progressive experience leading technology initiatives, enterprise systems, infrastructure, or IT operations
  • Demonstrated experience implementing automation, AI, or digital transformation initiatives that delivered measurable business outcomes
  • Strong knowledge of Microsoft 365, Azure, enterprise applications, and hybrid cloud environments
  • Experience evaluating, selecting, implementing, and optimizing business systems and technology platforms
  • Solid understanding of infrastructure, networking, cybersecurity, and identity management
  • Experience managing vendors, technology budgets, and third-party service providers
  • Familiarity with IT service management and project delivery methodologies
  • Relevant technical certifications are a plus
What We're Looking For
  • A hands-on technology leader who enjoys building solutions, not just managing them
  • Strong communicator who can work effectively with technical teams, business stakeholders, and executive leadership
  • Comfortable operating in a fast-moving environment where priorities can evolve and decisions must be made with incomplete information
  • Confident and collaborative, with the ability to influence without creating friction
  • Naturally curious about emerging technologies and passionate about using AI and automation to solve business challenges
  • Organized, adaptable, and capable of managing multiple priorities simultaneously

Apply today for immediate consideration! This is an immediate interview and hire opportunity

By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Benchmark IT, LLC and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here: https://bmarkits.com/privacy-policy/

IT Systems Administrator

Patterson, New York, United States
DIRECT HIRE
  • TERMS: direct hire
IT Systems Administrator

Employment Type: Full-Time

Location: Patterson, NY – On-Site Compensation: $90,000–$110,000 Base Work Authorization: U.S. Citizenship Required; this position does not offer employment sponsorship. Background Check: Required About the Role

Our client is seeking an IT Systems Administrator to provide hands-on, on-site IT support and help keep day-to-day technology operations running smoothly across office, engineering, and production environments.

This role will serve as the primary on-site resource for end-user support while also taking ownership of recurring systems, network, endpoint, and infrastructure tasks. A managed service provider (MSP) handles much of the Tier 2/Tier 3 support, so this position will work closely with the MSP while owning the hands-on work performed on-site.

The ideal candidate is a hands-on IT professional with solid networking and systems administration fundamentals who can work independently, manage a varied IT queue, and troubleshoot issues across both users and infrastructure.

Key Responsibilities End-User & On-Site IT Support
  • Serve as the primary on-site contact for users across office, engineering, and production environments.
  • Troubleshoot hardware, software, printing, connectivity, and workstation issues.
  • Own the day-to-day IT support queue and prioritize competing requests.
  • Install, configure, patch, and maintain workstations, laptops, servers, and business applications.
  • Provision and manage endpoints, including imaging, patching, endpoint protection, and asset tracking.
Network & Infrastructure Administration
  • Administer and troubleshoot FortiGate firewalls, Cisco switches, and 802.1X/NAC.
  • Perform routine network changes and troubleshooting under the direction of the IT Director.
  • Support core networking technologies including TCP/IP, DNS, DHCP, VLANs, and Wi-Fi.
  • Support VMware ESXi environments, hyperconverged infrastructure, and backups, escalating complex issues to the MSP or IT Director.
Microsoft & User Administration
  • Administer users, groups, and access within a Microsoft 365 environment.
  • Manage employee onboarding and offboarding.
  • Support Windows desktop and Windows Server environments, Active Directory, and related systems.
Security & IT Operations
  • Review patching reports and vulnerability scan results and address routine findings.
  • Help maintain endpoint security, patching, backups, and system health.
  • Follow and support security practices aligned with NIST 800-171 Rev. 2.
  • Maintain accurate documentation, equipment inventories, and IT records.
  • Coordinate effectively with the remote MSP on escalated systems and infrastructure issues.
Required Qualifications
  • 3–5 years of hands-on IT support or systems administration experience, preferably in a small-to-mid-sized organization.
  • Hands-on experience administering FortiGate firewalls and Cisco switches, including 802.1X/NAC.
  • Working knowledge of Windows desktop, Windows Server, Active Directory, and Microsoft 365.
  • Strong networking fundamentals, including TCP/IP, DNS, DHCP, VLANs, and Wi-Fi troubleshooting.
  • Experience installing, configuring, and patching operating systems and software.
  • Experience with endpoint management, patching, endpoint protection, backups, and asset tracking.
  • Ability to work independently on-site, manage a mixed IT queue, and coordinate effectively with a remote MSP.
  • Strong documentation and communication skills.
  • One or more relevant certifications such as CompTIA A+, Network+, Security+, Cisco CCNA, or Fortinet, or equivalent hands-on experience.
  • High school diploma required; associate degree in IT or a related field preferred.
  • Ability to work on-site and lift/move IT equipment.
  • U.S. citizenship required.
  • Ability to successfully complete a background check.
Preferred Qualifications
  • Experience administering VMware ESXi and hyperconverged or software-defined storage environments.
  • Experience administering a Microsoft 365 tenant or similar controlled/cloud environment.
  • Familiarity with NIST 800-171 Rev. 2, CMMC, or comparable security/compliance frameworks.
  • CCNA or Fortinet certification.
  • Experience supporting manufacturing, engineering, or other operational environments.
  • Familiarity with ERP systems; Odoo experience is a plus.
  • PowerShell or other scripting/automation experience for routine IT tasks.
Why This Role?
  • Hands-on ownership across end-user support, networking, systems, endpoints, and infrastructure.
  • Opportunity to work directly with an IT Director while partnering with an established MSP.
  • Exposure to enterprise networking, virtualization, Microsoft 365, endpoint security, and compliance.
  • A role with meaningful day-to-day responsibility rather than a narrowly defined help desk function.
  • $90,000–$110,000 base salary bonus eligible with a fully on-site work environment.
By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Benchmark IT, LLC and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here: https://bmarkits.com/privacy-policy/

Senior Network Security Engineer

Monroe , Connecticut, United States
DIRECT HIRE
  • TERMS: direct hire

Employment Type: Full-Time

Location: Monroe, CT Work Arrangement: Hybrid — 3 days onsite / 2 days remote after an initial 3-month period, subject to business needs Compensation: $106,000–$125,000 Base Salary Work Authorization: Candidates must be authorized to work in the U.S. without current or future employment sponsorship. About the Role

Our client is seeking a Senior Network Security Engineer to maintain, secure, and enhance a complex enterprise network infrastructure. This hands-on role will focus on network engineering, firewall and security administration, infrastructure reliability, and the design and implementation of network solutions.

The ideal candidate brings deep networking expertise, strong troubleshooting skills, and experience managing enterprise-scale network security environments. This individual will also contribute to infrastructure projects, technical documentation, and compliance with applicable industry and regulatory standards.

Key Responsibilities Network & Security Engineering
  • Administer, maintain, and enhance network infrastructure, including switches, routers, firewalls, VPNs, and network management systems.

  • Design, implement, and support network and security solutions, including standardized configurations and build templates.

  • Troubleshoot complex network issues, analyze traffic, and resolve performance, connectivity, and security problems.

  • Monitor network performance, resource utilization, licensing, and infrastructure health.

  • Ensure network equipment and configurations meet applicable security and compliance standards.

Architecture & Project Delivery
  • Design, install, and support new network hardware, software, and infrastructure.

  • Lead or coordinate network and security projects, managing scope, schedules, budgets, and resources.

  • Develop and maintain network diagrams, configuration standards, technical documentation, and work instructions.

  • Support infrastructure procurement, licensing, and vendor or contract activities.

  • Perform preventative maintenance and participate in a rotating after-hours support schedule.

Security & Continuous Improvement
  • Apply advanced network engineering and security principles to complex infrastructure challenges.

  • Support firewall management, network access controls, and network security investigations.

  • Use packet captures, protocol analysis, monitoring, and alerting tools to investigate and resolve issues.

  • Identify opportunities to improve network reliability, security, efficiency, and performance.

Required Qualifications
  • 8+ years of experience in network infrastructure engineering, including at least 4 years managing firewalls or network security systems.

  • Strong experience with Cisco routing and switching, enterprise network architecture, and network services.

  • Hands-on firewall configuration, maintenance, and troubleshooting experience.

  • Solid understanding of TCP/IP, DNS, DHCP, VPNs, network protocols, and network monitoring.

  • Experience designing, implementing, troubleshooting, and maintaining complex network environments.

  • Strong analytical, troubleshooting, and problem-solving skills.

  • Ability to manage projects, document technical solutions, and coordinate work across teams.

  • Excellent written, verbal, and interpersonal communication skills.

  • Bachelor’s degree in IT, business, or a related field.

  • Ability to participate in a rotating after-hours support schedule.

Preferred Qualifications
  • Experience with network security investigations and packet capture/protocol analysis.

  • Knowledge of network architecture standards, emerging technologies, and industry-specific regulatory requirements.

  • Experience creating detailed network design diagrams and technical documentation.

  • Cisco CCNA, CCNP, or relevant security certifications.

Why This Role?
  • Take ownership of network engineering and security across a complex enterprise environment.

  • Work on infrastructure design, network security, performance optimization, and technical projects.

  • Apply advanced troubleshooting and engineering skills to meaningful infrastructure challenges.

  • Collaborate with technical teams while contributing to long-term network architecture and security improvements.

  • Competitive $106,000–$131,000 base salary with benefits and a hybrid work arrangement after the initial three months.

    By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Benchmark IT, LLC and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here: https://bmarkits.com/privacy-policy/

Manager, Software Engineering - Java

White Plains, New York, United States
DIRECT HIRE
  • TERMS: direct hire
Manager, Software Engineering - Java Our client is a large, technology-driven organization seeking an experienced Manager, Software Engineering to lead teams responsible for business-critical applications and digital platforms. This role combines people leadership, technical fluency, delivery ownership, and business partnership. You’ll manage and develop senior software engineers and technical leads while providing the direction, coaching, staffing, prioritization, and support needed to deliver high-quality software. The ideal candidate is an experienced engineering leader who can balance people, technology, delivery, and business priorities while helping teams continuously improve. Key Responsibilities Engineering Leadership
  • Lead, coach, and develop software engineers and technical leads through feedback, goal setting, performance management, and career development.
  • Build effective teams through hiring, staffing, onboarding, and clear accountability.
  • Support the growth of senior engineers and emerging technical leaders.
Delivery & Business Partnership
  • Own delivery across scope, quality, timelines, dependencies, risk, budget, and operational readiness.
  • Partner with product, architecture, QA, operations, and business stakeholders to translate strategy into executable plans.
  • Help teams prioritize initiatives, communicate tradeoffs, and deliver measurable business outcomes.
  • Manage staffing and budgets for significant software initiatives.
Technical Leadership
  • Enable technical leads to drive architecture, design, code quality, and day-to-day engineering execution.
  • Guide teams working with technologies including Java, Angular, AWS, APIs, microservices, databases, and cloud platforms.
  • Promote strong practices around automated testing, CI/CD, observability, production support, and reliability.
Continuous Improvement & Innovation
  • Use engineering and team-performance metrics to improve delivery, quality, and reliability.
  • Strengthen incident response, root-cause analysis, and continuous improvement practices.
  • Support responsible adoption of AI-assisted software development, with appropriate human oversight, security, privacy, and quality controls.
Required Qualifications
  • 10+ years of progressive software engineering experience.
  • Proven experience managing or formally leading software engineering teams, including senior or lead-level engineers.
  • Strong understanding of the full software development lifecycle, including architecture, development, testing, deployment, production support, performance, and reliability.
  • Experience leading complex, business-critical software initiatives using Java, Angular, AWS, or comparable modern technologies.
  • Experience partnering with business and product leaders to define priorities, communicate technical tradeoffs, and deliver outcomes.
  • Experience managing staffing, delivery planning, dependencies, risk, and budgets for significant technology initiatives.
  • Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent professional experience.
  • Strong communication, leadership, analytical, and problem-solving skills.
Preferred Qualifications
  • Experience with cloud-native architecture, microservices, APIs, distributed systems, DevOps, automated delivery, and observability.
  • Experience managing multiple teams, technical leads, vendors, or distributed engineering partners.
  • Experience using engineering metrics to improve delivery and team performance.
  • Exposure to AI-assisted software development and modern engineering practices.
  • Experience in high-volume, customer-facing, transactional, retail, ecommerce, financial services, or similarly complex environments.
Why This Role
  • Lead and develop experienced software engineers and technical leaders.
  • Influence engineering culture, delivery practices, and technical execution.
  • Work on business-critical digital platforms with significant organizational impact.
  • Help shape modern software engineering and responsible AI adoption.
  • Competitive compensation, annual bonus eligibility, and comprehensive benefits.
  • Compensation: $140,000–$180,000 Base + Annual Bonus
Apply today for immediate consideration! This is immediate, interview and hire. This role will be on site 4 days per week in White Plains and will require an on site interview. By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Benchmark IT, LLC and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here: https://bmarkits.com/privacy-policy/

Principal/Staff Data Scientist, GenAI/LLM Evaluation, Long-Term Contract

Upper Saddle River, New Jersey, United States
CONTRACT
  • TERMS: contract
Principal/Staff Data Scientist, GenAI/LLM Evaluation Our direct client, a prestigious global firm, is creating a new advanced-technology organization. They are standing up AI evaluation as a first-class function and need a genuinely senior leader to build it. The firm’s products and agents will do various business functions which must be auditable. The standard is correct results every time, not “good enough for a personal assistant.” Because large language models are probabilistic, this takes real science. You will decide how to measure non-deterministic systems. You will find where they fail, including the corner cases nobody predicted. And you will design controls for the behavior that can’t be made deterministic. This is not a software-engineering or agent-building role. Other teams build the agents and own deployment and DevOps. You define how we know whether the agents can be trusted, and you build the team that does it. Note: this work can be performed from home, anywhere in the US. It is also open as a full-time salaried position as an alternative to long-term contract. What you’ll do
  • Establish and lead the evaluation function: set the vision, hire and develop leaders and build a team that runs with minimal day-to-day oversight.
  • Design evaluation harnesses and architecture for agentic and generative AI systems, both during development and in production.
  • Apply statistical and mathematical rigor to stochastic systems. That means deciding whether behavior can be made deterministic, how many runs are enough, how to separate real regressions from noise, and how to tell “succeeds at least once” from “succeeds every time.”
  • Where determinism isn’t possible, define fallback measures and compensating controls that detect and contain failures.
  • Monitor agents after deployment, detect failures and unexpected corner cases, and feed what you learn back into evaluation.
  • Define what “correct” means for multi-step work: accuracy against known-true data, sound reasoning and tool use, conclusions traceable to sources, and compliance with accounting and regulatory expectations.
  • Build and calibrate model-based graders by measuring agreement with human reviewers, checking for bias and watching for drift.
  • Partner with the engineering and DevOps teams who own agent development and release pipelines. Your results shape ship decisions.
Must have
  • A strong data science foundation: probability, statistics and linear algebra
  • Experience in both traditional machine learning and generative AI. Hands-on GenAI work is essential, since the evaluation problem is most severe there.
  • Hands-on experience designing or establishing evaluation infrastructure or architecture for ML or AI systems, built in practice and not just studied
  • The ability to walk through specific initiatives, lessons learned, problems encountered and how you solved them
  • Senior leadership experience: building teams, developing leaders and setting technical direction
  • Enough software engineering background to understand how systems are built and operated. About 5–6 years is sufficient if the rest of your career is in ML, data science or AI engineering.
  • Working understanding of CI/CD, deployment and production concepts. You won’t own them.
  • BS/MS or higher in a quantitative field such as statistics, data science, computer science or engineering. An advanced degree is a plus.
Nice to have
  • Regulated-industry exposure (audit, tax, accounting, financial services, regtech)
  • Experience making decisions explainable and auditable
  • Production monitoring and observability for ML or LLM systems
  • Experience with multi-agent systems or retrieval-based systems
  • Security and adversarial testing of AI (prompt injection, data leakage)
  • Hands-on use of public agent benchmarks or evaluation frameworks. Tell us which ones and what you’d change.
Immediate interview and start. Send your resume today, with a short note on the evaluation systems you’ve built and what you learned from them. By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Benchmark IT, LLC and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here: https://bmarkits.com/privacy-policy/

Java Tech Lead (AI Focus) - Hybrid

White Plains, New York, United States
CONTRACT
  • TERMS: contract

Our direct client, based in White Plains, NY, is seeking an AI-forward Technical Lead who leverages cutting-edge AI tools to transform software development processes. This is a long-term contract position (12-36+ months) with likely extension beyond. This role is a hybrid on-site position and you will be required to work on-site 4 days per week in White Plains, NY.

In this role, the Java Tech Lead will champion the integration of AI into every aspect of the development lifecycle while maintaining responsibility for the overall design, implementation and quality of the code the team produces across one or more projects. You will be expected to proactively identify opportunities to enhance development efficiency, code quality, and team productivity through AI tools and processes. You will partner with IT leadership, architecture, and development staff to establish AI-enhanced vision, strategy and road maps that align with business strategies and organizational priorities. You must collaborate with peers and leadership to leverage AI-driven knowledge and solutions across the organization.

This position is within a development group focused on leading the delivery of best-in-class systems to support client's business lines, across all channels. These include customer and internal applications built on AWS using Microservices Architecture and other AWS components that integrate with existing on-prem systems and databases.

Organizational Relationships:

The Technical Lead reports to the Director of Development and is accountable for daily status on tech design, development, and resource management. The Lead will collaborate with team members to define requirements, design, and develop mission critical applications while continuously exploring and implementing AI-enhanced workflows.

The Technical Lead works with:

  • Delivery leads to staff projects with associates, contractors, and/or third party teams
  • Project managers on a plan and estimates
  • Architecture and delivery leads on solution blueprints
  • QA and delivery leads on functional testing, integration testing, performance testing and to triage defects
  • Service introduction on hand-off to application operations team
Qualifications:
  • Proven experience utilizing AI tools for Java software development including code generation, review, documentation, testing, and debugging (e.g., Amazon Q, GitHub Copilot, or similar platforms)
  • Proactive, self-directed mindset for identifying and implementing AI-driven process improvements without waiting for top-down directives
  • Strong prompt engineering skills and commitment to continuous exploration of emerging AI tools to enhance development workflows
  • 8+ years experience in Java backend development demonstrating increasing levels of responsibility
  • Experience leading a team of 3 or more software developers and mentoring them in AI-enhanced development practices
  • Bachelor's degree in computer science or equivalent experience
  • Experience producing solution designs for large-scale, highly available, mission-critical systems
  • Proficient in designing, creating and consuming Web Services (REST, JSON, OAuth), multi-tier or microservice applications in Java and large scale database applications
  • Strong experience in SQL and data modeling
  • Demonstrate sound architecture skills and broad experience designing applications
  • Ability to communicate complex technical design concepts and translate into non-technical business solutions
  • Able to communicate well with all levels in the organization, and must be comfortable as a primary contact to internal and external customers
  • Excellent oral and written communication skills
  • Experience in Agile, Waterfall and other software development methodologies
Preferred Qualifications:
  • Experience with developing within a Cloud environment with good knowledge of cloud infrastructure like AWS is a plus
  • Hands-on experience with Amazon Q and Hero (current company AI tools)
  • Python scripting experience
  • Angular experience strongly preferred for any frontend development needs
  • Experience with ecommerce, retail, and financing is a plus
To ensure a fair and secure hiring process, candidates must complete live video interviews with cameras on and present valid government-issued identification during the process. All interviews are conducted directly with our internal team - proxy interviewing is not permitted.

Apply today for immediate consideration! This is immediate, interview and hire.

By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Benchmark IT, LLC and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here: https://bmarkits.com/privacy-policy/

Senior Systems Engineer

Tarrytown, New York, United States
DIRECT HIRE
  • TERMS: direct hire
Position Overview

Our non-profit healthcare client is seeking a Senior Systems Engineer to join its IT organization. This role focuses on engineering, building, and expanding the organization's Microsoft-based server and cloud infrastructure, alongside advanced systems administration and end-user support.

This role focuses on engineering, building, and expanding the organization's Microsoft-based server and cloud infrastructure, alongside advanced systems administration and end-user support.  The position also has a focus on endpoint engineering and modern workplace technologies, including Windows, Microsoft Intune, Microsoft Entra ID, Azure Virtual Desktop (AVD), Microsoft 365, software deployment, patching, and device lifecycle management.

Supporting an environment of 1,000+ endpoint devices, this individual will serve as a senior technical resource for complex endpoint, systems, device management, and virtual desktop issues. The role also requires a practical understanding of infrastructure dependencies, including Windows Server, networking, DNS, DHCP, VPN, firewalls, applications, databases, and identity services.

Key Responsibilities
  • Server Infrastructure Build & Expansion: Design, build, configure, and deploy Windows Server infrastructure from the ground up, and expand or enhance existing server environments as organizational needs evolve. This includes server provisioning, operating system installation and configuration, Active Directory and related services, storage, networking, security hardening, and integration into the existing infrastructure.

  • Design, implement, and maintain enterprise endpoint management solutions using Microsoft Intune, Microsoft Entra ID, Azure Virtual Desktop, and Microsoft 365.
  • Develop and maintain endpoint standards, configuration baselines, images, and device lifecycle processes.
  • Lead initiatives involving endpoint modernization, Windows upgrades, virtual desktop optimization, and device standardization.
  • Develop automation and scripting solutions using PowerShell, Python, or similar technologies to streamline endpoint administration.
  • Automate software deployments, patching, provisioning, onboarding, offboarding, and routine support functions.
  • Partner with ServiceNow and IT leadership to automate operational workflows and reduce manual processes.
  • Ensure timely deployment of operating system, third-party application, and security patches.
  • Support troubleshooting of infrastructure and cloud dependencies including authentication, DNS, DHCP, file services, print services, remote access, and application connectivity.
  • Troubleshoot application and database connectivity issues, including server dependencies, service accounts, connection strings, permissions, and network communication paths.
  • Support digital workplace technologies including Microsoft 365, Teams Rooms, collaboration platforms, mobile computing, and remote access technologies.
  • Serve as a Tier III escalation point for complex endpoint, operating system, application, and virtual desktop issues.
  • Develop self-service solutions, technical documentation, runbooks, knowledge articles, and support procedures.
  • Mentor support analysts and other IT staff on endpoint engineering best practices.
  • Lead endpoint-focused projects and collaborate with infrastructure, cybersecurity, application, and managed service provider teams.
  • Support endpoint technologies utilized in healthcare and clinical environments while maintaining security, compliance, and operational continuity.
What We're Looking For
  • Demonstrated hands-on experience building Windows Server infrastructure from scratch and expanding or reconfiguring existing server environments. Must be able to independently provision, configure, integrate, and troubleshoot server infrastructure—not solely administer or support environments built by others.
  • 5+ years of progressive experience in endpoint engineering, desktop engineering, workplace technology, or infrastructure operations.
  • 3+ years of experience administering enterprise endpoint management platforms.
  • Strong experience with Microsoft Intune, including configuration profiles, compliance policies, application deployment, Windows Autopilot, and device lifecycle management.
  • Experience with Microsoft Entra ID, including identity, groups, devices, and conditional access concepts.
  • Strong experience with Windows 10/11 Enterprise deployment, configuration, troubleshooting, patching, imaging, and lifecycle management.
  • Experience administering or supporting Azure Virtual Desktop (AVD), including host pools, user profiles, and remote desktop performance.
  • Experience with enterprise software deployment, patch management, endpoint security, and mobile device management.
  • Strong scripting and automation experience using PowerShell, Python, or similar technologies.
  • Experience with ServiceNow or another IT Service Management platform, including incident, request, change, asset, and knowledge management workflows.
  • Working knowledge of Windows Server, Active Directory-related services, DNS, DHCP, TCP/IP, routing, firewalls, VPN, and remote access technologies.
  • Ability to troubleshoot issues across endpoints, applications, servers, databases, networks, and identity services.
  • Strong documentation, communication, problem-solving, and root-cause analysis skills.
  • Experience working within ITIL/IT Service Management environments.
  • Healthcare or other regulated-industry experience is preferred.
Preferred Skills
  • Azure infrastructure services, including virtual machines, networking, storage, monitoring, and identity integration.
  • Microsoft Power Platform and low-code workflow automation.
  • Python or other automation languages.
  • Endpoint analytics, monitoring, vulnerability management, and configuration compliance tools.
  • Basic SQL Server and database connectivity knowledge.
  • Experience supporting healthcare, nonprofit, or other regulated environments.
Certifications

The following certifications are preferred/required based on experience:

  • Microsoft Certified: Endpoint Administrator Associate or equivalent
  • Microsoft Certified: Azure Administrator Associate or equivalent
  • ITIL Foundation certification or demonstrated experience working within ITIL-aligned practices
  • Microsoft 365 Administrator Expert is a plus
  • Microsoft security, networking, cybersecurity, or Windows Server certifications are a plus
Ideal Background

The ideal candidate is not simply a senior desktop support technician. This is an engineering-focused role for someone who has progressed from traditional desktop/support responsibilities into enterprise endpoint engineering, automation, systems administration, and digital workplace technologies.

The strongest candidates will be hands-on with Intune, Entra ID, AVD, Windows 10/11, Microsoft 365, endpoint automation, and ServiceNow, while also possessing enough infrastructure knowledge to understand how endpoints interact with servers, applications, databases, identity systems, and networks.

This individual should be comfortable serving as a Tier III escalation resource, taking ownership of complex technical problems, identifying root causes, automating repetitive processes, improving standards, and partnering across infrastructure, cybersecurity, applications, and support teams.

Compensation
  • Work Arrangement: On-site in Tarrytown, NY
  • Salary: $80,000–$90,000 annually, depending on experience and qualifications.

By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Benchmark IT, LLC and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy here: https://bmarkits.com/privacy-policy/